2023-12-03 10:53:12,643 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-12-03 10:53:12,883 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a 2023-12-03 10:53:12,896 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-12-03 10:53:12,896 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/cluster_b90589ee-8101-48f7-b85d-53817d79ec5a, deleteOnExit=true 2023-12-03 10:53:12,897 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-12-03 10:53:12,897 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/test.cache.data in system properties and HBase conf 2023-12-03 10:53:12,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/hadoop.tmp.dir in system properties and HBase conf 2023-12-03 10:53:12,898 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/hadoop.log.dir in system properties and HBase conf 2023-12-03 10:53:12,899 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-12-03 10:53:12,899 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-12-03 10:53:12,899 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-12-03 10:53:13,026 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-12-03 10:53:13,475 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-12-03 10:53:13,481 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-12-03 10:53:13,481 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-12-03 10:53:13,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-12-03 10:53:13,483 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-12-03 10:53:13,483 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-12-03 10:53:13,484 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-12-03 10:53:13,484 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-12-03 10:53:13,484 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-12-03 10:53:13,485 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-12-03 10:53:13,485 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/nfs.dump.dir in system properties and HBase conf 2023-12-03 10:53:13,486 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/java.io.tmpdir in system properties and HBase conf 2023-12-03 10:53:13,486 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-12-03 10:53:13,487 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-12-03 10:53:13,487 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-12-03 10:53:14,172 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-12-03 10:53:14,179 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-12-03 10:53:14,502 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-12-03 10:53:14,701 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-12-03 10:53:14,725 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-12-03 10:53:14,765 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-12-03 10:53:14,798 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/java.io.tmpdir/Jetty_localhost_35175_hdfs____7pvbr/webapp 2023-12-03 10:53:14,952 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35175 2023-12-03 10:53:14,964 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-12-03 10:53:14,965 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-12-03 10:53:15,471 WARN [Listener at localhost/39337] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-12-03 10:53:15,552 WARN [Listener at localhost/39337] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-12-03 10:53:15,570 WARN [Listener at localhost/39337] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-12-03 10:53:15,578 INFO [Listener at localhost/39337] log.Slf4jLog(67): jetty-6.1.26 2023-12-03 10:53:15,582 INFO [Listener at localhost/39337] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/java.io.tmpdir/Jetty_localhost_40083_datanode____2q42hi/webapp 2023-12-03 10:53:15,689 INFO [Listener at localhost/39337] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40083 2023-12-03 10:53:16,071 WARN [Listener at localhost/33475] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-12-03 10:53:16,596 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8475be6296330508: Processing first storage report for DS-46bef80c-d1c5-4b10-b4b1-2fc08f1dde4f from datanode 5023ecc4-1dcf-4444-bda1-68c9fa7731a2 2023-12-03 10:53:16,598 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8475be6296330508: from storage DS-46bef80c-d1c5-4b10-b4b1-2fc08f1dde4f node DatanodeRegistration(127.0.0.1:41675, datanodeUuid=5023ecc4-1dcf-4444-bda1-68c9fa7731a2, infoPort=44647, infoSecurePort=0, ipcPort=33475, storageInfo=lv=-57;cid=testClusterID;nsid=763463101;c=1701600794259), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-12-03 10:53:16,598 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8475be6296330508: Processing first storage report for DS-068f6ed7-b09f-462d-b766-4ebbc3685513 from datanode 5023ecc4-1dcf-4444-bda1-68c9fa7731a2 2023-12-03 10:53:16,598 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8475be6296330508: from storage DS-068f6ed7-b09f-462d-b766-4ebbc3685513 node DatanodeRegistration(127.0.0.1:41675, datanodeUuid=5023ecc4-1dcf-4444-bda1-68c9fa7731a2, infoPort=44647, infoSecurePort=0, ipcPort=33475, storageInfo=lv=-57;cid=testClusterID;nsid=763463101;c=1701600794259), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-12-03 10:53:16,614 DEBUG [Listener at localhost/33475] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a 2023-12-03 10:53:16,729 INFO [Listener at localhost/33475] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/cluster_b90589ee-8101-48f7-b85d-53817d79ec5a/zookeeper_0, clientPort=62442, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/cluster_b90589ee-8101-48f7-b85d-53817d79ec5a/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/cluster_b90589ee-8101-48f7-b85d-53817d79ec5a/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-12-03 10:53:16,746 INFO [Listener at localhost/33475] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62442 2023-12-03 10:53:16,758 INFO [Listener at localhost/33475] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-03 10:53:16,761 INFO [Listener at localhost/33475] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-03 10:53:17,458 INFO [Listener at localhost/33475] util.FSUtils(471): Created version file at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef with version=8 2023-12-03 10:53:17,458 INFO [Listener at localhost/33475] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/hbase-staging 2023-12-03 10:53:17,783 INFO [Listener at localhost/33475] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-12-03 10:53:18,243 INFO [Listener at localhost/33475] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=3 2023-12-03 10:53:18,275 INFO [Listener at localhost/33475] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-12-03 10:53:18,276 INFO [Listener at localhost/33475] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-12-03 10:53:18,276 INFO [Listener at localhost/33475] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-12-03 10:53:18,276 INFO [Listener at localhost/33475] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-12-03 10:53:18,276 INFO [Listener at localhost/33475] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-12-03 10:53:18,421 INFO [Listener at localhost/33475] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-12-03 10:53:18,491 DEBUG [Listener at localhost/33475] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-12-03 10:53:18,585 INFO [Listener at localhost/33475] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46307 2023-12-03 10:53:18,595 INFO [Listener at localhost/33475] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-03 10:53:18,597 INFO [Listener at localhost/33475] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-03 10:53:18,620 INFO [Listener at localhost/33475] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46307 connecting to ZooKeeper ensemble=127.0.0.1:62442 2023-12-03 10:53:18,663 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:463070x0, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-12-03 10:53:18,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46307-0x1004d5f843d0000 connected 2023-12-03 10:53:18,700 DEBUG [Listener at localhost/33475] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-12-03 10:53:18,701 DEBUG [Listener at localhost/33475] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-12-03 10:53:18,705 DEBUG [Listener at localhost/33475] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-12-03 10:53:18,715 DEBUG [Listener at localhost/33475] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46307 2023-12-03 10:53:18,716 DEBUG [Listener at localhost/33475] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46307 2023-12-03 10:53:18,718 DEBUG [Listener at localhost/33475] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46307 2023-12-03 10:53:18,719 DEBUG [Listener at localhost/33475] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46307 2023-12-03 10:53:18,720 DEBUG [Listener at localhost/33475] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46307 2023-12-03 10:53:18,726 INFO [Listener at localhost/33475] master.HMaster(444): hbase.rootdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef, hbase.cluster.distributed=false 2023-12-03 10:53:18,822 INFO [Listener at localhost/33475] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-12-03 10:53:18,822 INFO [Listener at localhost/33475] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-12-03 10:53:18,823 INFO [Listener at localhost/33475] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-12-03 10:53:18,823 INFO [Listener at localhost/33475] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-12-03 10:53:18,823 INFO [Listener at localhost/33475] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-12-03 10:53:18,823 INFO [Listener at localhost/33475] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-12-03 10:53:18,828 INFO [Listener at localhost/33475] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-12-03 10:53:18,831 INFO [Listener at localhost/33475] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44259 2023-12-03 10:53:18,833 INFO [Listener at localhost/33475] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-12-03 10:53:18,839 DEBUG [Listener at localhost/33475] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-12-03 10:53:18,840 INFO [Listener at localhost/33475] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-03 10:53:18,842 INFO [Listener at localhost/33475] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-03 10:53:18,845 INFO [Listener at localhost/33475] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44259 connecting to ZooKeeper ensemble=127.0.0.1:62442 2023-12-03 10:53:18,849 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:442590x0, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-12-03 10:53:18,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44259-0x1004d5f843d0001 connected 2023-12-03 10:53:18,850 DEBUG [Listener at localhost/33475] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-12-03 10:53:18,851 DEBUG [Listener at localhost/33475] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-12-03 10:53:18,852 DEBUG [Listener at localhost/33475] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-12-03 10:53:18,853 DEBUG [Listener at localhost/33475] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44259 2023-12-03 10:53:18,853 DEBUG [Listener at localhost/33475] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44259 2023-12-03 10:53:18,856 DEBUG [Listener at localhost/33475] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44259 2023-12-03 10:53:18,860 DEBUG [Listener at localhost/33475] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44259 2023-12-03 10:53:18,860 DEBUG [Listener at localhost/33475] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44259 2023-12-03 10:53:18,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46307,1701600797605 2023-12-03 10:53:18,878 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-12-03 10:53:18,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46307,1701600797605 2023-12-03 10:53:18,899 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-12-03 10:53:18,899 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-12-03 10:53:18,900 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-03 10:53:18,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-12-03 10:53:18,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46307,1701600797605 from backup master directory 2023-12-03 10:53:18,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-12-03 10:53:18,907 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46307,1701600797605 2023-12-03 10:53:18,907 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-12-03 10:53:18,908 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-12-03 10:53:18,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46307,1701600797605 2023-12-03 10:53:18,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-12-03 10:53:18,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-12-03 10:53:19,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/hbase.id with ID: eb91b26f-e8ee-4db6-8bd5-444bf9918f85 2023-12-03 10:53:19,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-03 10:53:19,064 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-03 10:53:19,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5a813ef7 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:53:19,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31e5982, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:53:19,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-12-03 10:53:19,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-12-03 10:53:19,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-12-03 10:53:19,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-12-03 10:53:19,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-12-03 10:53:19,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-12-03 10:53:19,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-12-03 10:53:19,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/data/master/store-tmp 2023-12-03 10:53:19,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:19,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-12-03 10:53:19,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-03 10:53:19,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-03 10:53:19,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-12-03 10:53:19,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-03 10:53:19,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-03 10:53:19,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-12-03 10:53:19,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/WALs/jenkins-hbase4.apache.org,46307,1701600797605 2023-12-03 10:53:19,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46307%2C1701600797605, suffix=, logDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/WALs/jenkins-hbase4.apache.org,46307,1701600797605, archiveDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/oldWALs, maxLogs=10 2023-12-03 10:53:19,372 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41675,DS-46bef80c-d1c5-4b10-b4b1-2fc08f1dde4f,DISK] 2023-12-03 10:53:19,381 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-12-03 10:53:19,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/WALs/jenkins-hbase4.apache.org,46307,1701600797605/jenkins-hbase4.apache.org%2C46307%2C1701600797605.1701600799312 2023-12-03 10:53:19,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41675,DS-46bef80c-d1c5-4b10-b4b1-2fc08f1dde4f,DISK]] 2023-12-03 10:53:19,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:53:19,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:19,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-12-03 10:53:19,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-12-03 10:53:19,539 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-12-03 10:53:19,546 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-12-03 10:53:19,572 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-12-03 10:53:19,584 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:19,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-12-03 10:53:19,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-12-03 10:53:19,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-12-03 10:53:19,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:53:19,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64406478, jitterRate=-0.04026868939399719}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:53:19,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-12-03 10:53:19,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-12-03 10:53:19,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-12-03 10:53:19,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-12-03 10:53:19,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-12-03 10:53:19,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 0 msec 2023-12-03 10:53:19,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 33 msec 2023-12-03 10:53:19,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-12-03 10:53:19,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-12-03 10:53:19,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-12-03 10:53:19,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-12-03 10:53:19,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-12-03 10:53:19,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-12-03 10:53:19,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-12-03 10:53:19,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-12-03 10:53:19,746 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-03 10:53:19,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-12-03 10:53:19,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-12-03 10:53:19,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-12-03 10:53:19,770 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-12-03 10:53:19,770 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-12-03 10:53:19,770 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-03 10:53:19,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46307,1701600797605, sessionid=0x1004d5f843d0000, setting cluster-up flag (Was=false) 2023-12-03 10:53:19,789 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-03 10:53:19,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-12-03 10:53:19,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46307,1701600797605 2023-12-03 10:53:19,806 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-03 10:53:19,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-12-03 10:53:19,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46307,1701600797605 2023-12-03 10:53:19,816 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp 2023-12-03 10:53:19,865 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(954): ClusterId : eb91b26f-e8ee-4db6-8bd5-444bf9918f85 2023-12-03 10:53:19,871 DEBUG [RS:0;jenkins-hbase4:44259] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-12-03 10:53:19,878 DEBUG [RS:0;jenkins-hbase4:44259] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-12-03 10:53:19,879 DEBUG [RS:0;jenkins-hbase4:44259] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-12-03 10:53:19,882 DEBUG [RS:0;jenkins-hbase4:44259] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-12-03 10:53:19,884 DEBUG [RS:0;jenkins-hbase4:44259] zookeeper.ReadOnlyZKClient(139): Connect 0x61fb2abe to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:53:19,889 DEBUG [RS:0;jenkins-hbase4:44259] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f3cd8f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:53:19,890 DEBUG [RS:0;jenkins-hbase4:44259] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b0341ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-12-03 10:53:19,919 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44259 2023-12-03 10:53:19,923 INFO [RS:0;jenkins-hbase4:44259] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-12-03 10:53:19,923 INFO [RS:0;jenkins-hbase4:44259] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-12-03 10:53:19,923 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1025): About to register with Master. 2023-12-03 10:53:19,926 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,46307,1701600797605 with isa=jenkins-hbase4.apache.org/172.31.14.131:44259, startcode=1701600798821 2023-12-03 10:53:19,942 DEBUG [RS:0;jenkins-hbase4:44259] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-12-03 10:53:19,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-12-03 10:53:19,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-12-03 10:53:19,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-12-03 10:53:19,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-12-03 10:53:19,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-12-03 10:53:19,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-12-03 10:53:19,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:19,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-12-03 10:53:19,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:19,997 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43877, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-12-03 10:53:20,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1701600830002 2023-12-03 10:53:20,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-12-03 10:53:20,009 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-12-03 10:53:20,009 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-12-03 10:53:20,009 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46307] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-12-03 10:53:20,014 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-12-03 10:53:20,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-12-03 10:53:20,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-12-03 10:53:20,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-12-03 10:53:20,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-12-03 10:53:20,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-12-03 10:53:20,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:20,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-12-03 10:53:20,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-12-03 10:53:20,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-12-03 10:53:20,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-12-03 10:53:20,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-12-03 10:53:20,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701600800038,5,FailOnTimeoutGroup] 2023-12-03 10:53:20,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701600800038,5,FailOnTimeoutGroup] 2023-12-03 10:53:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:20,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-12-03 10:53:20,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:20,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:20,049 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(2833): Master is not running yet 2023-12-03 10:53:20,050 WARN [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2023-12-03 10:53:20,151 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,46307,1701600797605 with isa=jenkins-hbase4.apache.org/172.31.14.131:44259, startcode=1701600798821 2023-12-03 10:53:20,159 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46307] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:20,167 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef 2023-12-03 10:53:20,167 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:39337 2023-12-03 10:53:20,167 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2023-12-03 10:53:20,173 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-12-03 10:53:20,174 DEBUG [RS:0;jenkins-hbase4:44259] zookeeper.ZKUtil(163): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:20,174 WARN [RS:0;jenkins-hbase4:44259] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-12-03 10:53:20,175 INFO [RS:0;jenkins-hbase4:44259] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-12-03 10:53:20,175 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1951): logDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/WALs/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:20,176 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44259,1701600798821] 2023-12-03 10:53:20,185 DEBUG [RS:0;jenkins-hbase4:44259] zookeeper.ZKUtil(163): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:20,199 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-12-03 10:53:20,211 INFO [RS:0;jenkins-hbase4:44259] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-12-03 10:53:20,230 INFO [RS:0;jenkins-hbase4:44259] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-12-03 10:53:20,233 INFO [RS:0;jenkins-hbase4:44259] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:53:20,233 INFO [RS:0;jenkins-hbase4:44259] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:20,234 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2023-12-03 10:53:20,241 INFO [RS:0;jenkins-hbase4:44259] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-12-03 10:53:20,241 DEBUG [RS:0;jenkins-hbase4:44259] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:20,242 DEBUG [RS:0;jenkins-hbase4:44259] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:20,242 DEBUG [RS:0;jenkins-hbase4:44259] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:20,242 DEBUG [RS:0;jenkins-hbase4:44259] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:20,242 DEBUG [RS:0;jenkins-hbase4:44259] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:20,242 DEBUG [RS:0;jenkins-hbase4:44259] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-12-03 10:53:20,242 DEBUG [RS:0;jenkins-hbase4:44259] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:20,242 DEBUG [RS:0;jenkins-hbase4:44259] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:20,242 DEBUG [RS:0;jenkins-hbase4:44259] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:20,242 DEBUG [RS:0;jenkins-hbase4:44259] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-03 10:53:20,244 INFO [RS:0;jenkins-hbase4:44259] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:20,244 INFO [RS:0;jenkins-hbase4:44259] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:20,244 INFO [RS:0;jenkins-hbase4:44259] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:20,261 INFO [RS:0;jenkins-hbase4:44259] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-12-03 10:53:20,263 INFO [RS:0;jenkins-hbase4:44259] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44259,1701600798821-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:20,279 INFO [RS:0;jenkins-hbase4:44259] regionserver.Replication(203): jenkins-hbase4.apache.org,44259,1701600798821 started 2023-12-03 10:53:20,279 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,44259,1701600798821, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44259, sessionid=0x1004d5f843d0001 2023-12-03 10:53:20,279 DEBUG [RS:0;jenkins-hbase4:44259] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-12-03 10:53:20,279 DEBUG [RS:0;jenkins-hbase4:44259] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:20,279 DEBUG [RS:0;jenkins-hbase4:44259] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44259,1701600798821' 2023-12-03 10:53:20,279 DEBUG [RS:0;jenkins-hbase4:44259] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:20,280 DEBUG [RS:0;jenkins-hbase4:44259] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:20,281 DEBUG [RS:0;jenkins-hbase4:44259] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-12-03 10:53:20,281 DEBUG [RS:0;jenkins-hbase4:44259] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-12-03 10:53:20,281 DEBUG [RS:0;jenkins-hbase4:44259] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:20,281 DEBUG [RS:0;jenkins-hbase4:44259] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44259,1701600798821' 2023-12-03 10:53:20,281 DEBUG [RS:0;jenkins-hbase4:44259] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-12-03 10:53:20,282 DEBUG [RS:0;jenkins-hbase4:44259] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-12-03 10:53:20,283 DEBUG [RS:0;jenkins-hbase4:44259] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-12-03 10:53:20,283 INFO [RS:0;jenkins-hbase4:44259] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-12-03 10:53:20,283 INFO [RS:0;jenkins-hbase4:44259] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-12-03 10:53:20,394 INFO [RS:0;jenkins-hbase4:44259] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44259%2C1701600798821, suffix=, logDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/WALs/jenkins-hbase4.apache.org,44259,1701600798821, archiveDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/oldWALs, maxLogs=32 2023-12-03 10:53:20,422 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41675,DS-46bef80c-d1c5-4b10-b4b1-2fc08f1dde4f,DISK] 2023-12-03 10:53:20,425 INFO [RS:0;jenkins-hbase4:44259] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/WALs/jenkins-hbase4.apache.org,44259,1701600798821/jenkins-hbase4.apache.org%2C44259%2C1701600798821.1701600800398 2023-12-03 10:53:20,426 DEBUG [RS:0;jenkins-hbase4:44259] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41675,DS-46bef80c-d1c5-4b10-b4b1-2fc08f1dde4f,DISK]] 2023-12-03 10:53:20,450 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-12-03 10:53:20,452 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-12-03 10:53:20,452 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef 2023-12-03 10:53:20,867 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:20,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-12-03 10:53:20,873 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/info 2023-12-03 10:53:20,874 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-12-03 10:53:20,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:20,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-12-03 10:53:20,878 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/rep_barrier 2023-12-03 10:53:20,879 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-12-03 10:53:20,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:20,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-12-03 10:53:20,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/table 2023-12-03 10:53:20,883 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-12-03 10:53:20,883 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:20,885 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740 2023-12-03 10:53:20,886 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740 2023-12-03 10:53:20,889 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-12-03 10:53:20,891 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-12-03 10:53:20,895 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:53:20,896 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65351129, jitterRate=-0.02619229257106781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-12-03 10:53:20,896 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-12-03 10:53:20,896 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-12-03 10:53:20,896 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-12-03 10:53:20,896 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-12-03 10:53:20,896 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-12-03 10:53:20,896 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-12-03 10:53:20,897 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-12-03 10:53:20,898 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-12-03 10:53:20,904 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-12-03 10:53:20,904 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-12-03 10:53:20,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-12-03 10:53:20,923 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-12-03 10:53:20,926 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-12-03 10:53:21,078 DEBUG [jenkins-hbase4:46307] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-12-03 10:53:21,081 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44259,1701600798821, state=OPENING 2023-12-03 10:53:21,091 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-12-03 10:53:21,092 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-03 10:53:21,093 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-12-03 10:53:21,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:53:21,286 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:21,288 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-12-03 10:53:21,293 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-12-03 10:53:21,305 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-12-03 10:53:21,306 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-12-03 10:53:21,309 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44259%2C1701600798821.meta, suffix=.meta, logDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/WALs/jenkins-hbase4.apache.org,44259,1701600798821, archiveDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/oldWALs, maxLogs=32 2023-12-03 10:53:21,325 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41675,DS-46bef80c-d1c5-4b10-b4b1-2fc08f1dde4f,DISK] 2023-12-03 10:53:21,330 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/WALs/jenkins-hbase4.apache.org,44259,1701600798821/jenkins-hbase4.apache.org%2C44259%2C1701600798821.meta.1701600801310.meta 2023-12-03 10:53:21,332 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41675,DS-46bef80c-d1c5-4b10-b4b1-2fc08f1dde4f,DISK]] 2023-12-03 10:53:21,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:53:21,335 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-12-03 10:53:21,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-12-03 10:53:21,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-12-03 10:53:21,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-12-03 10:53:21,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:21,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-12-03 10:53:21,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-12-03 10:53:21,375 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-12-03 10:53:21,377 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/info 2023-12-03 10:53:21,377 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/info 2023-12-03 10:53:21,377 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-12-03 10:53:21,378 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:21,379 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-12-03 10:53:21,380 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/rep_barrier 2023-12-03 10:53:21,380 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/rep_barrier 2023-12-03 10:53:21,381 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-12-03 10:53:21,382 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:21,382 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-12-03 10:53:21,383 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/table 2023-12-03 10:53:21,383 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/table 2023-12-03 10:53:21,384 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-12-03 10:53:21,385 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:21,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740 2023-12-03 10:53:21,389 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740 2023-12-03 10:53:21,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-12-03 10:53:21,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-12-03 10:53:21,396 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70819119, jitterRate=0.055287107825279236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-12-03 10:53:21,396 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-12-03 10:53:21,405 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1701600801278 2023-12-03 10:53:21,426 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2023-12-03 10:53:21,427 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-12-03 10:53:21,427 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44259,1701600798821, state=OPEN 2023-12-03 10:53:21,434 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-12-03 10:53:21,434 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-12-03 10:53:21,438 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2023-12-03 10:53:21,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44259,1701600798821 in 337 msec 2023-12-03 10:53:21,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2023-12-03 10:53:21,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 529 msec 2023-12-03 10:53:21,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5610 sec 2023-12-03 10:53:21,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1701600801450, completionTime=-1 2023-12-03 10:53:21,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-12-03 10:53:21,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-12-03 10:53:21,518 DEBUG [hconnection-0x40bb67a9-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:53:21,523 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:53:21,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-12-03 10:53:21,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1701600861547 2023-12-03 10:53:21,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1701600921547 2023-12-03 10:53:21,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 96 msec 2023-12-03 10:53:21,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46307,1701600797605-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:21,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46307,1701600797605-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:21,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46307,1701600797605-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:21,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46307, period=300000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:21,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-12-03 10:53:21,582 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-12-03 10:53:21,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-12-03 10:53:21,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-12-03 10:53:21,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-12-03 10:53:21,606 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:53:21,609 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:53:21,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:53:21,638 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d empty. 2023-12-03 10:53:21,639 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:53:21,639 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-12-03 10:53:22,063 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-12-03 10:53:22,066 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => eb5a693c652f5b30580c302a0d3e7b3d, NAME => 'hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:53:22,479 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:22,479 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing eb5a693c652f5b30580c302a0d3e7b3d, disabling compactions & flushes 2023-12-03 10:53:22,479 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:53:22,479 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:53:22,479 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. after waiting 0 ms 2023-12-03 10:53:22,479 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:53:22,479 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:53:22,479 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for eb5a693c652f5b30580c302a0d3e7b3d: 2023-12-03 10:53:22,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:53:22,499 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701600802488"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600802488"}]},"ts":"1701600802488"} 2023-12-03 10:53:22,530 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-03 10:53:22,533 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:53:22,537 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600802533"}]},"ts":"1701600802533"} 2023-12-03 10:53:22,543 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-12-03 10:53:22,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=eb5a693c652f5b30580c302a0d3e7b3d, ASSIGN}] 2023-12-03 10:53:22,553 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=eb5a693c652f5b30580c302a0d3e7b3d, ASSIGN 2023-12-03 10:53:22,555 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=eb5a693c652f5b30580c302a0d3e7b3d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:53:22,706 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=eb5a693c652f5b30580c302a0d3e7b3d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:22,706 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701600802706"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600802706"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600802706"}]},"ts":"1701600802706"} 2023-12-03 10:53:22,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure eb5a693c652f5b30580c302a0d3e7b3d, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:53:22,865 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:22,872 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:53:22,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb5a693c652f5b30580c302a0d3e7b3d, NAME => 'hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:53:22,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:53:22,874 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:22,874 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:53:22,874 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:53:22,876 INFO [StoreOpener-eb5a693c652f5b30580c302a0d3e7b3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:53:22,878 DEBUG [StoreOpener-eb5a693c652f5b30580c302a0d3e7b3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d/info 2023-12-03 10:53:22,878 DEBUG [StoreOpener-eb5a693c652f5b30580c302a0d3e7b3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d/info 2023-12-03 10:53:22,879 INFO [StoreOpener-eb5a693c652f5b30580c302a0d3e7b3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb5a693c652f5b30580c302a0d3e7b3d columnFamilyName info 2023-12-03 10:53:22,879 INFO [StoreOpener-eb5a693c652f5b30580c302a0d3e7b3d-1] regionserver.HStore(310): Store=eb5a693c652f5b30580c302a0d3e7b3d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:22,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:53:22,882 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:53:22,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:53:22,890 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:53:22,891 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eb5a693c652f5b30580c302a0d3e7b3d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65330706, jitterRate=-0.02649661898612976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:53:22,891 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eb5a693c652f5b30580c302a0d3e7b3d: 2023-12-03 10:53:22,893 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d., pid=6, masterSystemTime=1701600802865 2023-12-03 10:53:22,898 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:53:22,898 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:53:22,899 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=eb5a693c652f5b30580c302a0d3e7b3d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:22,900 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701600802898"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600802898"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600802898"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600802898"}]},"ts":"1701600802898"} 2023-12-03 10:53:22,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2023-12-03 10:53:22,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure eb5a693c652f5b30580c302a0d3e7b3d, server=jenkins-hbase4.apache.org,44259,1701600798821 in 192 msec 2023-12-03 10:53:22,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2023-12-03 10:53:22,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=eb5a693c652f5b30580c302a0d3e7b3d, ASSIGN in 356 msec 2023-12-03 10:53:22,911 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:53:22,911 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600802911"}]},"ts":"1701600802911"} 2023-12-03 10:53:22,915 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-12-03 10:53:22,919 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:53:22,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3260 sec 2023-12-03 10:53:23,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-12-03 10:53:23,010 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-12-03 10:53:23,010 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-03 10:53:23,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-12-03 10:53:23,062 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-12-03 10:53:23,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-12-03 10:53:23,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-12-03 10:53:23,095 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-12-03 10:53:23,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 23 msec 2023-12-03 10:53:23,118 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-12-03 10:53:23,121 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-12-03 10:53:23,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.213sec 2023-12-03 10:53:23,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-12-03 10:53:23,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-12-03 10:53:23,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-12-03 10:53:23,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46307,1701600797605-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-12-03 10:53:23,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46307,1701600797605-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-12-03 10:53:23,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-12-03 10:53:23,173 DEBUG [Listener at localhost/33475] zookeeper.ReadOnlyZKClient(139): Connect 0x0b2a962e to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:53:23,179 DEBUG [Listener at localhost/33475] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79a41f20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:53:23,192 DEBUG [hconnection-0x6295a77a-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:53:23,208 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:53:23,218 INFO [Listener at localhost/33475] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46307,1701600797605 2023-12-03 10:53:23,220 DEBUG [Listener at localhost/33475] zookeeper.ReadOnlyZKClient(139): Connect 0x7faa020d to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:53:23,226 DEBUG [Listener at localhost/33475] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41eb7af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:53:23,226 INFO [Listener at localhost/33475] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-03 10:53:23,265 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=283, ProcessCount=171, AvailableMemoryMB=3472 2023-12-03 10:53:23,276 DEBUG [Listener at localhost/33475] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:53:23,279 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:53:23,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-12-03 10:53:23,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:23,296 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:53:23,299 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:53:23,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-12-03 10:53:23,302 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:23,303 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348 empty. 2023-12-03 10:53:23,305 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:23,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-12-03 10:53:23,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-12-03 10:53:23,322 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-12-03 10:53:23,324 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 68d8dbb8a8d74773b96cfe331b55f348, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:53:23,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-12-03 10:53:23,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-12-03 10:53:23,737 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:23,737 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 68d8dbb8a8d74773b96cfe331b55f348, disabling compactions & flushes 2023-12-03 10:53:23,738 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:23,738 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:23,738 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. after waiting 0 ms 2023-12-03 10:53:23,738 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:23,738 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:23,738 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:23,742 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:53:23,744 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701600803744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600803744"}]},"ts":"1701600803744"} 2023-12-03 10:53:23,747 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-03 10:53:23,749 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:53:23,750 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600803749"}]},"ts":"1701600803749"} 2023-12-03 10:53:23,752 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-12-03 10:53:23,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=68d8dbb8a8d74773b96cfe331b55f348, ASSIGN}] 2023-12-03 10:53:23,761 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=68d8dbb8a8d74773b96cfe331b55f348, ASSIGN 2023-12-03 10:53:23,763 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=68d8dbb8a8d74773b96cfe331b55f348, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:53:23,914 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=68d8dbb8a8d74773b96cfe331b55f348, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:23,915 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701600803914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600803914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600803914"}]},"ts":"1701600803914"} 2023-12-03 10:53:23,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 68d8dbb8a8d74773b96cfe331b55f348, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:53:23,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-12-03 10:53:24,072 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:24,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:24,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 68d8dbb8a8d74773b96cfe331b55f348, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:53:24,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:24,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:24,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:24,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:24,082 INFO [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:24,084 DEBUG [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1 2023-12-03 10:53:24,084 DEBUG [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1 2023-12-03 10:53:24,087 INFO [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68d8dbb8a8d74773b96cfe331b55f348 columnFamilyName family1 2023-12-03 10:53:24,091 INFO [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] regionserver.HStore(310): Store=68d8dbb8a8d74773b96cfe331b55f348/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:24,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:24,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:24,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:24,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:53:24,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 68d8dbb8a8d74773b96cfe331b55f348; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74254399, jitterRate=0.10647676885128021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:53:24,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:24,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348., pid=11, masterSystemTime=1701600804072 2023-12-03 10:53:24,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:24,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:24,111 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=68d8dbb8a8d74773b96cfe331b55f348, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:24,111 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701600804111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600804111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600804111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600804111"}]},"ts":"1701600804111"} 2023-12-03 10:53:24,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2023-12-03 10:53:24,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 68d8dbb8a8d74773b96cfe331b55f348, server=jenkins-hbase4.apache.org,44259,1701600798821 in 197 msec 2023-12-03 10:53:24,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2023-12-03 10:53:24,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=68d8dbb8a8d74773b96cfe331b55f348, ASSIGN in 359 msec 2023-12-03 10:53:24,123 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:53:24,123 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600804123"}]},"ts":"1701600804123"} 2023-12-03 10:53:24,125 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-12-03 10:53:24,130 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:53:24,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 838 msec 2023-12-03 10:53:24,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-12-03 10:53:24,428 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-12-03 10:53:24,446 DEBUG [hconnection-0x454c6449-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:53:24,449 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:53:24,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:24,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:24,596 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:24,596 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:24,596 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-12-03 10:53:24,596 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-12-03 10:53:24,597 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:24,597 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:24,600 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:24,600 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:24,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:24,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:24,600 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:24,601 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:24,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:24,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:24,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:24,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:24,602 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:24,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:24,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-12-03 10:53:24,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:24,605 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-12-03 10:53:24,606 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:24,606 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:24,606 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:24,607 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. started... 2023-12-03 10:53:24,608 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 68d8dbb8a8d74773b96cfe331b55f348 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-12-03 10:53:25,154 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a0386f041f4f4694b01a00a45abb3c97 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130a0386f041f4f4694b01a00a45abb3c97 2023-12-03 10:53:25,571 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/3111a050ce9e4cecb31ab5564f846628 2023-12-03 10:53:25,582 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/3111a050ce9e4cecb31ab5564f846628 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3111a050ce9e4cecb31ab5564f846628 2023-12-03 10:53:25,592 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3111a050ce9e4cecb31ab5564f846628, entries=1000, sequenceid=5, filesize=175.8 K 2023-12-03 10:53:25,595 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 68d8dbb8a8d74773b96cfe331b55f348 in 987ms, sequenceid=5, compaction requested=false 2023-12-03 10:53:25,597 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:25,600 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:25,600 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:25,600 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:25,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:25,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-12-03 10:53:25,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-12-03 10:53:25,604 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:25,605 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,605 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:25,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-12-03 10:53:25,608 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-12-03 10:53:25,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5822c3b2[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:25,608 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,611 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,612 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-12-03 10:53:25,612 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-12-03 10:53:25,612 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:25,612 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,612 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-12-03 10:53:25,615 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-12-03 10:53:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:25,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:25,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:25,620 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-12-03 10:53:25,620 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:25,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-12-03 10:53:25,620 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:25,620 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,621 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:25,623 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,623 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:25,624 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:25,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:25,625 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,627 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:25,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:25,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:25,636 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:25,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:25,636 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:25,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:25,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:25,638 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:25,638 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:25,738 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:25,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:25,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:25,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:25,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,758 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:25,758 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:25,759 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-12-03 10:53:25,759 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-12-03 10:53:25,760 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,760 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,765 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:25,765 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:25,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:25,765 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:25,765 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:25,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:25,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,767 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-12-03 10:53:25,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:25,767 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-12-03 10:53:25,767 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:25,767 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-12-03 10:53:25,768 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:25,768 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:25,768 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:25,768 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. started... 2023-12-03 10:53:25,768 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 68d8dbb8a8d74773b96cfe331b55f348 1/1 column families, dataSize=74 B heapSize=408 B 2023-12-03 10:53:26,198 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a0a0e58fad5c4163b1641adee943993d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128a0a0e58fad5c4163b1641adee943993d 2023-12-03 10:53:26,206 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-12-03 10:53:26,211 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-12-03 10:53:26,211 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/ba091f4c3b474203945d090b5a01350b 2023-12-03 10:53:26,220 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/ba091f4c3b474203945d090b5a01350b as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/ba091f4c3b474203945d090b5a01350b 2023-12-03 10:53:26,228 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/ba091f4c3b474203945d090b5a01350b, entries=1, sequenceid=9, filesize=5.0 K 2023-12-03 10:53:26,229 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 68d8dbb8a8d74773b96cfe331b55f348 in 461ms, sequenceid=9, compaction requested=false 2023-12-03 10:53:26,230 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:26,230 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-12-03 10:53:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-12-03 10:53:26,234 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,234 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:26,234 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:26,235 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:26,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-12-03 10:53:26,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bb6f9e1[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:26,237 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-12-03 10:53:26,237 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,239 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-12-03 10:53:26,240 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-12-03 10:53:26,240 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:26,240 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,240 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:26,242 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,242 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-12-03 10:53:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:26,242 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:26,242 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-12-03 10:53:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:26,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-12-03 10:53:26,246 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-12-03 10:53:26,246 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:26,246 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:26,246 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,246 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:26,249 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,249 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,249 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:26,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:26,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:26,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:26,250 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:26,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,253 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:26,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,257 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,257 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,257 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,257 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:26,257 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:26,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:26,257 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,257 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:26,257 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:26,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:26,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:26,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:26,257 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:26,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-12-03 10:53:26,257 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,258 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:26,259 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:26,359 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:26,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:26,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:26,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:26,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,372 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:26,373 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:26,373 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-12-03 10:53:26,373 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-12-03 10:53:26,374 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,374 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,376 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:26,376 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:26,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:26,376 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,376 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:26,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:26,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,378 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,378 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-12-03 10:53:26,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,378 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-12-03 10:53:26,378 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:26,379 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-12-03 10:53:26,379 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:26,379 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:26,379 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:26,379 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. started... 2023-12-03 10:53:26,379 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 68d8dbb8a8d74773b96cfe331b55f348 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:26,416 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ec66b179a38b4d138bf4e8bddcbef73b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ec66b179a38b4d138bf4e8bddcbef73b 2023-12-03 10:53:26,831 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/d9435a28b80349e991337c03dc78e270 2023-12-03 10:53:26,840 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/d9435a28b80349e991337c03dc78e270 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/d9435a28b80349e991337c03dc78e270 2023-12-03 10:53:26,850 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/d9435a28b80349e991337c03dc78e270, entries=1, sequenceid=13, filesize=5.0 K 2023-12-03 10:53:26,852 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 68d8dbb8a8d74773b96cfe331b55f348 in 473ms, sequenceid=13, compaction requested=true 2023-12-03 10:53:26,852 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:26,852 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:26,852 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:26,853 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:26,853 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,853 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-12-03 10:53:26,853 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-12-03 10:53:26,855 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,855 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:26,856 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,856 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:26,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-12-03 10:53:26,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76b4e142[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:26,859 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-12-03 10:53:26,859 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,862 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,862 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-12-03 10:53:26,862 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-12-03 10:53:26,862 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:26,862 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,862 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:26,864 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,864 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-12-03 10:53:26,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:26,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:26,865 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:26,865 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-12-03 10:53:26,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:26,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:26,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:26,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-12-03 10:53:26,869 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-12-03 10:53:26,869 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:26,869 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:26,869 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,869 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:26,872 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,872 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:26,872 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:26,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:26,873 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:26,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,876 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,880 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,880 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,880 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,881 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:26,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:26,881 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:26,881 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,881 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,881 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,881 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,882 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:26,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:26,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:26,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:26,883 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:26,883 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:26,899 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:53:26,983 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:26,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:26,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:26,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:26,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,995 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:26,995 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:26,996 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-12-03 10:53:26,996 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-12-03 10:53:26,997 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,997 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:26,999 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:26,999 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:26,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:26,999 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:26,999 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:27,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:27,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,001 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,001 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-12-03 10:53:27,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,001 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-12-03 10:53:27,001 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:27,002 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-12-03 10:53:27,002 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:27,002 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:27,002 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:27,002 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. started... 2023-12-03 10:53:27,002 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 68d8dbb8a8d74773b96cfe331b55f348 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:27,027 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050d5f5baf2033431ca75a148b9f046d3e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512050d5f5baf2033431ca75a148b9f046d3e 2023-12-03 10:53:27,440 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/6f10b9defcde42a9b75066dacb135634 2023-12-03 10:53:27,449 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/6f10b9defcde42a9b75066dacb135634 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/6f10b9defcde42a9b75066dacb135634 2023-12-03 10:53:27,458 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/6f10b9defcde42a9b75066dacb135634, entries=1, sequenceid=17, filesize=5.0 K 2023-12-03 10:53:27,460 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 68d8dbb8a8d74773b96cfe331b55f348 in 458ms, sequenceid=17, compaction requested=true 2023-12-03 10:53:27,460 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:27,460 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:27,460 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:27,461 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:27,461 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,461 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-12-03 10:53:27,461 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-12-03 10:53:27,464 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,464 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:27,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:27,465 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,465 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:27,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:27,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:27,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:27,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-12-03 10:53:27,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@388d4dc1[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:27,467 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-12-03 10:53:27,467 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,469 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,469 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-12-03 10:53:27,469 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-12-03 10:53:27,469 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:27,469 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,469 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:27,471 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-12-03 10:53:27,471 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,471 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:27,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:27,471 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-12-03 10:53:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:27,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:27,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:27,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:27,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-12-03 10:53:27,475 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-12-03 10:53:27,476 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:27,476 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:27,476 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,476 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:27,482 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,483 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:27,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:27,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,483 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:27,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:27,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:27,483 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,485 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,490 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,490 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,490 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:27,490 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:27,490 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:27,490 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:27,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:27,490 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,490 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:27,491 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,491 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,491 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:27,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:27,491 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:27,592 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:27,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:27,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:27,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:27,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,605 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:27,605 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:27,605 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-12-03 10:53:27,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-12-03 10:53:27,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,608 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:27,608 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:27,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:27,609 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:27,609 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:27,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:27,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,610 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,610 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-12-03 10:53:27,610 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:27,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-12-03 10:53:27,611 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:27,611 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-12-03 10:53:27,611 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:27,611 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:27,611 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:27,611 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. started... 2023-12-03 10:53:27,611 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 68d8dbb8a8d74773b96cfe331b55f348 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:27,779 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-12-03 10:53:27,780 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-12-03 10:53:28,035 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122841d329f1891a406690dbf3213c486e5d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122841d329f1891a406690dbf3213c486e5d 2023-12-03 10:53:28,449 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/089a5debeb184808893bdcfe9aa3f783 2023-12-03 10:53:28,459 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/089a5debeb184808893bdcfe9aa3f783 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/089a5debeb184808893bdcfe9aa3f783 2023-12-03 10:53:28,468 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/089a5debeb184808893bdcfe9aa3f783, entries=1, sequenceid=21, filesize=5.0 K 2023-12-03 10:53:28,469 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 68d8dbb8a8d74773b96cfe331b55f348 in 858ms, sequenceid=21, compaction requested=true 2023-12-03 10:53:28,470 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:28,470 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:28,470 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:28,470 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:28,470 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,471 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-12-03 10:53:28,471 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-12-03 10:53:28,473 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,473 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:28,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:28,473 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,473 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:28,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:28,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-12-03 10:53:28,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76fc3631[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:28,476 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-12-03 10:53:28,476 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,478 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,479 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-12-03 10:53:28,479 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-12-03 10:53:28,479 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,479 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:28,479 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:28,481 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,481 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-12-03 10:53:28,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:28,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:28,481 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:28,481 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-12-03 10:53:28,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:28,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:28,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:28,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-12-03 10:53:28,485 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-12-03 10:53:28,485 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:28,485 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:28,485 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,485 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:28,487 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,487 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,487 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:28,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:28,488 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:28,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,489 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:28,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:28,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:28,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:28,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:28,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:28,493 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:28,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,494 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,494 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,494 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:28,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:28,494 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:28,495 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:28,595 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:28,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:28,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:28,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:28,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,607 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:28,607 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:28,608 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-12-03 10:53:28,608 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-12-03 10:53:28,608 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,608 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,611 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,611 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:28,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:28,611 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:28,611 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:28,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,612 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,613 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-12-03 10:53:28,613 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-12-03 10:53:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-12-03 10:53:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:28,614 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:28,614 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:28,614 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. started... 2023-12-03 10:53:28,614 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 68d8dbb8a8d74773b96cfe331b55f348 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:29,079 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312d9b66d0308f48de8824328953a5af56 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312d9b66d0308f48de8824328953a5af56 2023-12-03 10:53:29,493 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/3437138c856f435cbb92ebeec8f2b1bd 2023-12-03 10:53:29,502 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/3437138c856f435cbb92ebeec8f2b1bd as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3437138c856f435cbb92ebeec8f2b1bd 2023-12-03 10:53:29,511 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3437138c856f435cbb92ebeec8f2b1bd, entries=1, sequenceid=25, filesize=5.0 K 2023-12-03 10:53:29,512 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 68d8dbb8a8d74773b96cfe331b55f348 in 898ms, sequenceid=25, compaction requested=true 2023-12-03 10:53:29,512 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:29,512 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:29,512 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:29,512 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:29,512 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-12-03 10:53:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-12-03 10:53:29,515 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,515 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:29,515 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:29,515 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:29,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-12-03 10:53:29,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a49a0fe[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:29,517 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-12-03 10:53:29,517 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,519 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,519 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-12-03 10:53:29,519 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-12-03 10:53:29,519 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:29,519 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,519 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:29,522 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-12-03 10:53:29,522 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,522 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,522 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-12-03 10:53:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:29,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-12-03 10:53:29,526 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-12-03 10:53:29,527 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:29,527 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:29,527 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,527 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:29,530 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,530 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:29,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,530 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:29,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:29,531 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,533 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:29,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:29,537 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:29,537 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,537 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,537 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:29,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:29,537 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:29,537 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:29,538 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:29,538 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:29,638 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:29,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:29,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:29,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:29,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,650 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:29,650 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:29,650 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-12-03 10:53:29,650 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-12-03 10:53:29,651 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,651 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,653 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,653 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:29,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:29,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:29,653 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:29,653 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:29,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:29,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,655 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,655 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-12-03 10:53:29,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:29,655 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-12-03 10:53:29,655 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-12-03 10:53:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:29,656 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:29,656 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. started... 2023-12-03 10:53:29,656 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 68d8dbb8a8d74773b96cfe331b55f348 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:30,078 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d0e21fbd515f4d3fb404f69f0f963d18 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101d0e21fbd515f4d3fb404f69f0f963d18 2023-12-03 10:53:30,487 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/700e6ab6369f49b38eeb6cbe0ab53b7b 2023-12-03 10:53:30,496 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/700e6ab6369f49b38eeb6cbe0ab53b7b as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/700e6ab6369f49b38eeb6cbe0ab53b7b 2023-12-03 10:53:30,505 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/700e6ab6369f49b38eeb6cbe0ab53b7b, entries=1, sequenceid=29, filesize=5.0 K 2023-12-03 10:53:30,507 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 68d8dbb8a8d74773b96cfe331b55f348 in 851ms, sequenceid=29, compaction requested=true 2023-12-03 10:53:30,507 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:30,508 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:30,508 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:30,508 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:30,508 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,508 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-12-03 10:53:30,508 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-12-03 10:53:30,515 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,515 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:30,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:30,515 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,515 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:30,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:30,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:30,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:30,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-12-03 10:53:30,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b26e804[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:30,518 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-12-03 10:53:30,518 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,519 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,520 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-12-03 10:53:30,520 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-12-03 10:53:30,520 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:30,520 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,520 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:30,522 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-12-03 10:53:30,522 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,522 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:30,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:30,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:30,522 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-12-03 10:53:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:30,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:30,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-12-03 10:53:30,525 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-12-03 10:53:30,526 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:30,526 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:30,526 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,526 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:30,529 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,529 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:30,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:30,529 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:30,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:30,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:30,530 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,531 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:30,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:30,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:30,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:30,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:30,536 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:30,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:30,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:30,537 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,537 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,537 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:30,537 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:30,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:30,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:30,637 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:30,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:30,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:30,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:30,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,648 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:30,649 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:30,649 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-12-03 10:53:30,649 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-12-03 10:53:30,650 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,650 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,651 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:30,651 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:30,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:30,652 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:30,652 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:30,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:30,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,653 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,653 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-12-03 10:53:30,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:30,653 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-12-03 10:53:30,653 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:30,654 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-12-03 10:53:30,654 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:30,654 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:30,654 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:30,654 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. started... 2023-12-03 10:53:30,654 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 68d8dbb8a8d74773b96cfe331b55f348 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:30,674 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103006d942a78974db6952b540d3efd40bb to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103006d942a78974db6952b540d3efd40bb 2023-12-03 10:53:31,083 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/585268b2ed864a22868ba66c3daf64ab 2023-12-03 10:53:31,092 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/585268b2ed864a22868ba66c3daf64ab as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/585268b2ed864a22868ba66c3daf64ab 2023-12-03 10:53:31,100 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/585268b2ed864a22868ba66c3daf64ab, entries=1, sequenceid=33, filesize=5.0 K 2023-12-03 10:53:31,101 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 68d8dbb8a8d74773b96cfe331b55f348 in 447ms, sequenceid=33, compaction requested=true 2023-12-03 10:53:31,101 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:31,101 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:31,101 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:31,102 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:31,102 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,102 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-12-03 10:53:31,102 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-12-03 10:53:31,104 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,104 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:31,105 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,105 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:31,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:31,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:31,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:31,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-12-03 10:53:31,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@391753e4[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:31,107 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-12-03 10:53:31,107 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,108 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,109 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-12-03 10:53:31,109 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-12-03 10:53:31,109 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,109 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:31,109 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:31,111 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-12-03 10:53:31,111 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,111 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:31,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:31,111 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-12-03 10:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:31,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:31,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:31,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:31,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-12-03 10:53:31,116 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-12-03 10:53:31,116 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:31,116 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:31,116 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,116 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:31,118 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,118 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:31,118 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:31,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:31,120 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:31,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,122 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:31,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,125 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,125 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,126 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,126 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:31,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:31,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:31,126 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:31,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:31,126 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:31,126 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:31,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,127 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:31,127 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:31,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:31,227 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:31,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:31,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:31,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:31,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,240 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:31,240 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:31,240 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-12-03 10:53:31,240 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-12-03 10:53:31,241 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,241 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,243 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:31,243 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:31,243 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,244 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:31,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,244 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,245 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-12-03 10:53:31,245 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,246 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-12-03 10:53:31,246 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:31,246 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-12-03 10:53:31,246 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:31,246 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:31,246 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:31,247 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. started... 2023-12-03 10:53:31,247 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 68d8dbb8a8d74773b96cfe331b55f348 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:31,668 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073dcbfef38d574e1aa98b2653c036a4c0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509073dcbfef38d574e1aa98b2653c036a4c0 2023-12-03 10:53:31,677 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/66f4e6d512c64ffc85999f8777c88b6f 2023-12-03 10:53:31,685 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/66f4e6d512c64ffc85999f8777c88b6f as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/66f4e6d512c64ffc85999f8777c88b6f 2023-12-03 10:53:31,692 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/66f4e6d512c64ffc85999f8777c88b6f, entries=1, sequenceid=37, filesize=5.0 K 2023-12-03 10:53:31,693 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 68d8dbb8a8d74773b96cfe331b55f348 in 446ms, sequenceid=37, compaction requested=true 2023-12-03 10:53:31,694 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:31,694 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:31,694 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:31,694 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:31,694 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,694 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-12-03 10:53:31,694 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-12-03 10:53:31,697 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,697 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:31,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:31,698 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,698 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:31,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:31,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:31,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:31,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-12-03 10:53:31,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e4da749[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:31,700 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-12-03 10:53:31,700 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,701 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,701 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-12-03 10:53:31,701 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-12-03 10:53:31,702 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:31,702 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,702 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:31,704 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,704 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-12-03 10:53:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,704 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:31,704 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-12-03 10:53:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:31,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:31,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-12-03 10:53:31,709 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-12-03 10:53:31,709 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:31,709 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:31,709 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,709 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:31,711 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,712 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,712 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:31,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:31,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:31,712 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,714 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,722 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:31,722 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:31,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:31,722 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,722 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:31,722 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:31,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:31,722 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,723 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:31,723 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:31,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:31,823 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:31,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:31,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:31,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:31,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,834 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:31,834 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:31,835 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-12-03 10:53:31,835 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-12-03 10:53:31,835 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,836 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,837 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:31,837 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:31,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:31,838 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:31,838 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:31,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,839 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,839 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-12-03 10:53:31,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:31,839 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-12-03 10:53:31,839 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:31,840 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-12-03 10:53:31,841 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:31,841 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:31,841 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:31,841 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. started... 2023-12-03 10:53:31,841 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 68d8dbb8a8d74773b96cfe331b55f348 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:32,261 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204d59020ce56f4042966e56b8a4c2a468 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511204d59020ce56f4042966e56b8a4c2a468 2023-12-03 10:53:32,270 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/fd6f7e6f2b4b45d88ee3371ec758a88f 2023-12-03 10:53:32,277 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/fd6f7e6f2b4b45d88ee3371ec758a88f as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/fd6f7e6f2b4b45d88ee3371ec758a88f 2023-12-03 10:53:32,283 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/fd6f7e6f2b4b45d88ee3371ec758a88f, entries=1, sequenceid=41, filesize=5.0 K 2023-12-03 10:53:32,285 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 68d8dbb8a8d74773b96cfe331b55f348 in 444ms, sequenceid=41, compaction requested=true 2023-12-03 10:53:32,285 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:32,285 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-12-03 10:53:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-12-03 10:53:32,288 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,288 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:32,289 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,289 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:32,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:32,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-12-03 10:53:32,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5974bc2e[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:32,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-12-03 10:53:32,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,293 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,293 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-12-03 10:53:32,294 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,294 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:32,294 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-12-03 10:53:32,294 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:32,296 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-12-03 10:53:32,296 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,296 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:32,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:32,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:32,297 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-12-03 10:53:32,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:32,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:32,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:32,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:32,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-12-03 10:53:32,301 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-12-03 10:53:32,301 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:32,301 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:32,301 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,301 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:32,303 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,303 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:32,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:32,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,303 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:32,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:32,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:32,304 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:32,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:32,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,306 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:32,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,310 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,310 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:32,310 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:32,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:32,310 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:32,310 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,310 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:32,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-12-03 10:53:32,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:32,310 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,310 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:32,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:32,310 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:32,311 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,311 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:32,311 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:32,411 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:32,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:32,418 DEBUG [Listener at localhost/33475] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-12-03 10:53:32,421 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-12-03 10:53:32,422 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:32,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-12-03 10:53:32,437 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-12-03 10:53:32,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:53:32,439 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601412439 2023-12-03 10:53:32,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:53:32,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-12-03 10:53:32,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-12-03 10:53:32,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x0ef0abd8 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:53:32,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c54a081, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:53:32,455 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:33,328 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fe20c9653b3c41b8b3beb61661188bcc to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103fe20c9653b3c41b8b3beb61661188bcc 2023-12-03 10:53:33,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-12-03 10:53:33,351 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:53:33,353 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:53:33,365 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:53:33,367 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:53:33,402 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1b97c0a22b3a4409aedf35b91358235b first=Optional[r3] last=Optional[r6] 2023-12-03 10:53:33,415 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1b97c0a22b3a4409aedf35b91358235b}] 2023-12-03 10:53:33,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1b97c0a22b3a4409aedf35b91358235b for inclusion in 68d8dbb8a8d74773b96cfe331b55f348/family1 2023-12-03 10:53:33,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-12-03 10:53:33,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:53:33,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:33,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1b97c0a22b3a4409aedf35b91358235b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kugrjrcqmru25n6k0j4c74orvo899d9s0ksnh2um4tc4o5l84i6t1or3epgcvblb/family1/1b97c0a22b3a4409aedf35b91358235b 2023-12-03 10:53:33,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kugrjrcqmru25n6k0j4c74orvo899d9s0ksnh2um4tc4o5l84i6t1or3epgcvblb/family1/1b97c0a22b3a4409aedf35b91358235b as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/60439935287149a0a34e5cda2c3e0a6e_SeqId_44_ 2023-12-03 10:53:33,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kugrjrcqmru25n6k0j4c74orvo899d9s0ksnh2um4tc4o5l84i6t1or3epgcvblb/family1/1b97c0a22b3a4409aedf35b91358235b into 68d8dbb8a8d74773b96cfe331b55f348/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/60439935287149a0a34e5cda2c3e0a6e_SeqId_44_ - updating store file list. 2023-12-03 10:53:33,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/60439935287149a0a34e5cda2c3e0a6e_SeqId_44_ into 68d8dbb8a8d74773b96cfe331b55f348/family1 2023-12-03 10:53:33,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kugrjrcqmru25n6k0j4c74orvo899d9s0ksnh2um4tc4o5l84i6t1or3epgcvblb/family1/1b97c0a22b3a4409aedf35b91358235b into 68d8dbb8a8d74773b96cfe331b55f348/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/60439935287149a0a34e5cda2c3e0a6e_SeqId_44_) 2023-12-03 10:53:33,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kugrjrcqmru25n6k0j4c74orvo899d9s0ksnh2um4tc4o5l84i6t1or3epgcvblb/family1/1b97c0a22b3a4409aedf35b91358235b 2023-12-03 10:53:33,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-12-03 10:53:33,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-12-03 10:53:33,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): 68d8dbb8a8d74773b96cfe331b55f348/family1 is initiating minor compaction 2023-12-03 10:53:33,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3fdbab48; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:33,466 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 68d8dbb8a8d74773b96cfe331b55f348/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:33,466 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/ba091f4c3b474203945d090b5a01350b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/d9435a28b80349e991337c03dc78e270, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/6f10b9defcde42a9b75066dacb135634, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/089a5debeb184808893bdcfe9aa3f783, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3437138c856f435cbb92ebeec8f2b1bd, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/700e6ab6369f49b38eeb6cbe0ab53b7b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/585268b2ed864a22868ba66c3daf64ab, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/66f4e6d512c64ffc85999f8777c88b6f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/fd6f7e6f2b4b45d88ee3371ec758a88f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/60439935287149a0a34e5cda2c3e0a6e_SeqId_44_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp, totalSize=50.2 K 2023-12-03 10:53:33,467 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting ba091f4c3b474203945d090b5a01350b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-12-03 10:53:33,467 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting d9435a28b80349e991337c03dc78e270, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-12-03 10:53:33,467 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 6f10b9defcde42a9b75066dacb135634, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-12-03 10:53:33,467 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 089a5debeb184808893bdcfe9aa3f783, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-12-03 10:53:33,467 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 3437138c856f435cbb92ebeec8f2b1bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-12-03 10:53:33,468 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 700e6ab6369f49b38eeb6cbe0ab53b7b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-12-03 10:53:33,468 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 585268b2ed864a22868ba66c3daf64ab, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-12-03 10:53:33,468 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 66f4e6d512c64ffc85999f8777c88b6f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-12-03 10:53:33,468 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting fd6f7e6f2b4b45d88ee3371ec758a88f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-12-03 10:53:33,468 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 60439935287149a0a34e5cda2c3e0a6e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-12-03 10:53:33,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-12-03 10:53:33,482 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:33,489 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122841d329f1891a406690dbf3213c486e5d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122841d329f1891a406690dbf3213c486e5d 2023-12-03 10:53:33,491 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312d9b66d0308f48de8824328953a5af56 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312d9b66d0308f48de8824328953a5af56 2023-12-03 10:53:33,493 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101d0e21fbd515f4d3fb404f69f0f963d18 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101d0e21fbd515f4d3fb404f69f0f963d18 2023-12-03 10:53:33,495 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103006d942a78974db6952b540d3efd40bb to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103006d942a78974db6952b540d3efd40bb 2023-12-03 10:53:33,495 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-12-03 10:53:33,495 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-12-03 10:53:33,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:33,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:33,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:33,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:33,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:33,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:33,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:33,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:33,527 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 68d8dbb8a8d74773b96cfe331b55f348#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:53:34,362 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/2259428fde724f5eb39a2a79c1be5e3e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/2259428fde724f5eb39a2a79c1be5e3e 2023-12-03 10:53:34,382 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 68d8dbb8a8d74773b96cfe331b55f348/family1 of 68d8dbb8a8d74773b96cfe331b55f348 into 2259428fde724f5eb39a2a79c1be5e3e(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:53:34,382 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:34,384 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1701600813464; duration=0sec 2023-12-03 10:53:34,385 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:34,392 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ca9f212ed7a24e6d823774b666bf5ef5 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca9f212ed7a24e6d823774b666bf5ef5 2023-12-03 10:53:34,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-12-03 10:53:34,427 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/33cffaf09bd44138b11a3d1d8b309268 first=Optional[r00] last=Optional[r2] 2023-12-03 10:53:34,428 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/33cffaf09bd44138b11a3d1d8b309268}] 2023-12-03 10:53:34,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/33cffaf09bd44138b11a3d1d8b309268 for inclusion in 68d8dbb8a8d74773b96cfe331b55f348/family1 2023-12-03 10:53:34,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-12-03 10:53:34,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:53:34,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:34,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/33cffaf09bd44138b11a3d1d8b309268 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kmtalgljeuse3rufhra05gn1trc29ea32vtkt2dtlb6faqlm0lneqvg2p0igukf6/family1/33cffaf09bd44138b11a3d1d8b309268 2023-12-03 10:53:34,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kmtalgljeuse3rufhra05gn1trc29ea32vtkt2dtlb6faqlm0lneqvg2p0igukf6/family1/33cffaf09bd44138b11a3d1d8b309268 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/4507bce89a8a44668c913a6add734122_SeqId_47_ 2023-12-03 10:53:34,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kmtalgljeuse3rufhra05gn1trc29ea32vtkt2dtlb6faqlm0lneqvg2p0igukf6/family1/33cffaf09bd44138b11a3d1d8b309268 into 68d8dbb8a8d74773b96cfe331b55f348/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/4507bce89a8a44668c913a6add734122_SeqId_47_ - updating store file list. 2023-12-03 10:53:34,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/ba091f4c3b474203945d090b5a01350b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/d9435a28b80349e991337c03dc78e270, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/6f10b9defcde42a9b75066dacb135634, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/089a5debeb184808893bdcfe9aa3f783, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3437138c856f435cbb92ebeec8f2b1bd, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/700e6ab6369f49b38eeb6cbe0ab53b7b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/585268b2ed864a22868ba66c3daf64ab, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/66f4e6d512c64ffc85999f8777c88b6f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/fd6f7e6f2b4b45d88ee3371ec758a88f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/60439935287149a0a34e5cda2c3e0a6e_SeqId_44_] to archive 2023-12-03 10:53:34,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:34,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/4507bce89a8a44668c913a6add734122_SeqId_47_ into 68d8dbb8a8d74773b96cfe331b55f348/family1 2023-12-03 10:53:34,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kmtalgljeuse3rufhra05gn1trc29ea32vtkt2dtlb6faqlm0lneqvg2p0igukf6/family1/33cffaf09bd44138b11a3d1d8b309268 into 68d8dbb8a8d74773b96cfe331b55f348/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/4507bce89a8a44668c913a6add734122_SeqId_47_) 2023-12-03 10:53:34,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kmtalgljeuse3rufhra05gn1trc29ea32vtkt2dtlb6faqlm0lneqvg2p0igukf6/family1/33cffaf09bd44138b11a3d1d8b309268 2023-12-03 10:53:34,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-12-03 10:53:34,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/ba091f4c3b474203945d090b5a01350b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/ba091f4c3b474203945d090b5a01350b 2023-12-03 10:53:34,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-12-03 10:53:34,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): 68d8dbb8a8d74773b96cfe331b55f348/family1 is initiating minor compaction (all files) 2023-12-03 10:53:34,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@77a9f55e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:34,467 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 68d8dbb8a8d74773b96cfe331b55f348/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:34,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/d9435a28b80349e991337c03dc78e270 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/d9435a28b80349e991337c03dc78e270 2023-12-03 10:53:34,468 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3111a050ce9e4cecb31ab5564f846628, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/2259428fde724f5eb39a2a79c1be5e3e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/4507bce89a8a44668c913a6add734122_SeqId_47_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp, totalSize=358.6 K 2023-12-03 10:53:34,469 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 3111a050ce9e4cecb31ab5564f846628, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823227 2023-12-03 10:53:34,470 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 2259428fde724f5eb39a2a79c1be5e3e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223227 2023-12-03 10:53:34,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/6f10b9defcde42a9b75066dacb135634 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/6f10b9defcde42a9b75066dacb135634 2023-12-03 10:53:34,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-12-03 10:53:34,471 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 4507bce89a8a44668c913a6add734122_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823227 2023-12-03 10:53:34,473 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:34,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/089a5debeb184808893bdcfe9aa3f783 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/089a5debeb184808893bdcfe9aa3f783 2023-12-03 10:53:34,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3437138c856f435cbb92ebeec8f2b1bd to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3437138c856f435cbb92ebeec8f2b1bd 2023-12-03 10:53:34,477 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130a0386f041f4f4694b01a00a45abb3c97 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130a0386f041f4f4694b01a00a45abb3c97 2023-12-03 10:53:34,479 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ec66b179a38b4d138bf4e8bddcbef73b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ec66b179a38b4d138bf4e8bddcbef73b 2023-12-03 10:53:34,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/700e6ab6369f49b38eeb6cbe0ab53b7b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/700e6ab6369f49b38eeb6cbe0ab53b7b 2023-12-03 10:53:34,481 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512050d5f5baf2033431ca75a148b9f046d3e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512050d5f5baf2033431ca75a148b9f046d3e 2023-12-03 10:53:34,482 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-12-03 10:53:34,482 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-12-03 10:53:34,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/585268b2ed864a22868ba66c3daf64ab to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/585268b2ed864a22868ba66c3daf64ab 2023-12-03 10:53:34,483 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:34,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-12-03 10:53:34,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:53:34,484 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-12-03 10:53:34,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/66f4e6d512c64ffc85999f8777c88b6f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/66f4e6d512c64ffc85999f8777c88b6f 2023-12-03 10:53:34,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0560 sec 2023-12-03 10:53:34,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/fd6f7e6f2b4b45d88ee3371ec758a88f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/fd6f7e6f2b4b45d88ee3371ec758a88f 2023-12-03 10:53:34,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/60439935287149a0a34e5cda2c3e0a6e_SeqId_44_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/60439935287149a0a34e5cda2c3e0a6e_SeqId_44_ 2023-12-03 10:53:34,515 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 68d8dbb8a8d74773b96cfe331b55f348#family1#compaction#11 average throughput is 6.61 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:53:34,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-12-03 10:53:34,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:34,684 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-12-03 10:53:34,686 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-12-03 10:53:34,686 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-12-03 10:53:34,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-12-03 10:53:34,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=68d8dbb8a8d74773b96cfe331b55f348, REOPEN/MOVE}] 2023-12-03 10:53:34,705 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=68d8dbb8a8d74773b96cfe331b55f348, REOPEN/MOVE 2023-12-03 10:53:34,706 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=68d8dbb8a8d74773b96cfe331b55f348, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:34,707 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701600814706"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600814706"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600814706"}]},"ts":"1701600814706"} 2023-12-03 10:53:34,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 68d8dbb8a8d74773b96cfe331b55f348, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:53:34,868 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:34,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:34,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 68d8dbb8a8d74773b96cfe331b55f348, disabling compactions & flushes 2023-12-03 10:53:34,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:35,351 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/.tmp/family1/94d9e08592f144babc26a1cc0e6d8def as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/94d9e08592f144babc26a1cc0e6d8def 2023-12-03 10:53:35,360 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 68d8dbb8a8d74773b96cfe331b55f348/family1 of 68d8dbb8a8d74773b96cfe331b55f348 into 94d9e08592f144babc26a1cc0e6d8def(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:53:35,360 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:35,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:35,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:35,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. after waiting 0 ms 2023-12-03 10:53:35,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:35,360 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1701600814467; duration=0sec 2023-12-03 10:53:35,360 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:35,363 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3111a050ce9e4cecb31ab5564f846628, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/2259428fde724f5eb39a2a79c1be5e3e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/4507bce89a8a44668c913a6add734122_SeqId_47_] to archive 2023-12-03 10:53:35,364 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:35,367 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3111a050ce9e4cecb31ab5564f846628 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/3111a050ce9e4cecb31ab5564f846628 2023-12-03 10:53:35,368 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/2259428fde724f5eb39a2a79c1be5e3e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/2259428fde724f5eb39a2a79c1be5e3e 2023-12-03 10:53:35,370 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/4507bce89a8a44668c913a6add734122_SeqId_47_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/4507bce89a8a44668c913a6add734122_SeqId_47_ 2023-12-03 10:53:35,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-12-03 10:53:35,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:35,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:35,377 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 68d8dbb8a8d74773b96cfe331b55f348 to self. 2023-12-03 10:53:35,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:35,379 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=68d8dbb8a8d74773b96cfe331b55f348, regionState=CLOSED 2023-12-03 10:53:35,380 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701600815379"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600815379"}]},"ts":"1701600815379"} 2023-12-03 10:53:35,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2023-12-03 10:53:35,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 68d8dbb8a8d74773b96cfe331b55f348, server=jenkins-hbase4.apache.org,44259,1701600798821 in 673 msec 2023-12-03 10:53:35,385 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=68d8dbb8a8d74773b96cfe331b55f348, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=true 2023-12-03 10:53:35,535 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=68d8dbb8a8d74773b96cfe331b55f348, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:35,536 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701600815535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600815535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600815535"}]},"ts":"1701600815535"} 2023-12-03 10:53:35,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 68d8dbb8a8d74773b96cfe331b55f348, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:53:35,692 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:35,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:35,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 68d8dbb8a8d74773b96cfe331b55f348, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:53:35,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:35,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:35,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:35,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:35,699 INFO [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:35,700 DEBUG [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1 2023-12-03 10:53:35,700 DEBUG [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1 2023-12-03 10:53:35,701 INFO [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68d8dbb8a8d74773b96cfe331b55f348 columnFamilyName family1 2023-12-03 10:53:35,709 DEBUG [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/94d9e08592f144babc26a1cc0e6d8def 2023-12-03 10:53:35,710 INFO [StoreOpener-68d8dbb8a8d74773b96cfe331b55f348-1] regionserver.HStore(310): Store=68d8dbb8a8d74773b96cfe331b55f348/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:35,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:35,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:35,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:53:35,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 68d8dbb8a8d74773b96cfe331b55f348; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67758745, jitterRate=0.009683981537818909}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:53:35,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:35,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348., pid=17, masterSystemTime=1701600815692 2023-12-03 10:53:35,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:35,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:53:35,721 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=68d8dbb8a8d74773b96cfe331b55f348, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:35,721 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701600815721"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600815721"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600815721"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600815721"}]},"ts":"1701600815721"} 2023-12-03 10:53:35,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=15 2023-12-03 10:53:35,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 68d8dbb8a8d74773b96cfe331b55f348, server=jenkins-hbase4.apache.org,44259,1701600798821 in 184 msec 2023-12-03 10:53:35,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=15, resume processing ppid=14 2023-12-03 10:53:35,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=68d8dbb8a8d74773b96cfe331b55f348, REOPEN/MOVE in 1.0220 sec 2023-12-03 10:53:35,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2023-12-03 10:53:35,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0390 sec 2023-12-03 10:53:35,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0720 sec 2023-12-03 10:53:35,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-12-03 10:53:35,743 INFO [Listener at localhost/33475] compactions.TestMobCompactor(278): alter status finished 2023-12-03 10:53:35,744 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-12-03 10:53:35,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-12-03 10:53:35,747 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-12-03 10:53:35,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:53:35,748 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601415748 2023-12-03 10:53:35,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:53:35,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-12-03 10:53:35,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-12-03 10:53:35,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x0092e441 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:53:35,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f42db5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:53:35,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:35,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:35,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:35,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:35,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:35,805 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284e8c25a86f1644e2a907344b30540aec to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511284e8c25a86f1644e2a907344b30540aec 2023-12-03 10:53:35,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-12-03 10:53:35,820 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:53:35,821 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:53:35,829 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:53:35,831 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:53:35,842 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dfa2386903c40949301ccd5188d0ee3 first=Optional[r05] last=Optional[r8] 2023-12-03 10:53:35,843 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=51 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dfa2386903c40949301ccd5188d0ee3}] 2023-12-03 10:53:35,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dfa2386903c40949301ccd5188d0ee3 for inclusion in 68d8dbb8a8d74773b96cfe331b55f348/family1 2023-12-03 10:53:35,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-12-03 10:53:35,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:53:35,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:53:35,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dfa2386903c40949301ccd5188d0ee3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f3gd8ajm9agp1dukdt6scvhrd7rafnj437it6uis5t4olg7ibnruhureamn2k880/family1/7dfa2386903c40949301ccd5188d0ee3 2023-12-03 10:53:35,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f3gd8ajm9agp1dukdt6scvhrd7rafnj437it6uis5t4olg7ibnruhureamn2k880/family1/7dfa2386903c40949301ccd5188d0ee3 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/f74678ae47e64903bf3971aeb1da97f6_SeqId_53_ 2023-12-03 10:53:35,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f3gd8ajm9agp1dukdt6scvhrd7rafnj437it6uis5t4olg7ibnruhureamn2k880/family1/7dfa2386903c40949301ccd5188d0ee3 into 68d8dbb8a8d74773b96cfe331b55f348/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/f74678ae47e64903bf3971aeb1da97f6_SeqId_53_ - updating store file list. 2023-12-03 10:53:35,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/f74678ae47e64903bf3971aeb1da97f6_SeqId_53_ into 68d8dbb8a8d74773b96cfe331b55f348/family1 2023-12-03 10:53:35,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f3gd8ajm9agp1dukdt6scvhrd7rafnj437it6uis5t4olg7ibnruhureamn2k880/family1/7dfa2386903c40949301ccd5188d0ee3 into 68d8dbb8a8d74773b96cfe331b55f348/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/family1/f74678ae47e64903bf3971aeb1da97f6_SeqId_53_) 2023-12-03 10:53:35,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f3gd8ajm9agp1dukdt6scvhrd7rafnj437it6uis5t4olg7ibnruhureamn2k880/family1/7dfa2386903c40949301ccd5188d0ee3 2023-12-03 10:53:35,867 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-12-03 10:53:35,868 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:35,870 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511204d59020ce56f4042966e56b8a4c2a468 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511204d59020ce56f4042966e56b8a4c2a468 2023-12-03 10:53:35,871 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128a0a0e58fad5c4163b1641adee943993d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128a0a0e58fad5c4163b1641adee943993d 2023-12-03 10:53:35,871 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-12-03 10:53:35,871 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-12-03 10:53:35,872 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:35,872 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:35,872 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-12-03 10:53:35,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-12-03 10:53:35,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:53:35,873 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-12-03 10:53:35,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 128 msec 2023-12-03 10:53:35,970 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=251 (was 213) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1a882b8a-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62442@0x0092e441-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62442@0x0092e441 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/606735526.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:46700 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:46748 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62442@0x0ef0abd8-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35298 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ea26a62-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35210 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:46720 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62442@0x0ef0abd8-SendThread(127.0.0.1:62442) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1a882b8a-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35324 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35330 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35268 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62442@0x0ef0abd8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/606735526.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-232089398_17 at /127.0.0.1:35280 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35288 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35402 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ea26a62-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ea26a62-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1a882b8a-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1a882b8a-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1a882b8a-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:44259-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35334 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35224 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62442@0x0092e441-SendThread(127.0.0.1:62442) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35376 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=619 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=242 (was 283), ProcessCount=171 (was 171), AvailableMemoryMB=3433 (was 3472) 2023-12-03 10:53:35,988 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=619, MaxFileDescriptor=60000, SystemLoadAverage=242, ProcessCount=171, AvailableMemoryMB=3432 2023-12-03 10:53:35,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-12-03 10:53:35,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:35,994 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:53:35,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-12-03 10:53:35,995 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:53:35,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-12-03 10:53:35,997 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5 2023-12-03 10:53:35,997 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5 empty. 2023-12-03 10:53:35,998 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5 2023-12-03 10:53:35,998 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-12-03 10:53:36,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-12-03 10:53:36,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-12-03 10:53:36,409 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-12-03 10:53:36,411 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => ce9122c7de6f34aabd8844002ba75fb5, NAME => 'testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:53:36,417 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:36,417 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing ce9122c7de6f34aabd8844002ba75fb5, disabling compactions & flushes 2023-12-03 10:53:36,417 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:36,417 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:36,417 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. after waiting 0 ms 2023-12-03 10:53:36,418 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:36,418 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:36,418 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:36,420 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:53:36,421 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701600816421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600816421"}]},"ts":"1701600816421"} 2023-12-03 10:53:36,423 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-03 10:53:36,424 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:53:36,424 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600816424"}]},"ts":"1701600816424"} 2023-12-03 10:53:36,426 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-12-03 10:53:36,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=ce9122c7de6f34aabd8844002ba75fb5, ASSIGN}] 2023-12-03 10:53:36,430 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=ce9122c7de6f34aabd8844002ba75fb5, ASSIGN 2023-12-03 10:53:36,431 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=ce9122c7de6f34aabd8844002ba75fb5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:53:36,583 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ce9122c7de6f34aabd8844002ba75fb5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:36,583 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701600816583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600816583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600816583"}]},"ts":"1701600816583"} 2023-12-03 10:53:36,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure ce9122c7de6f34aabd8844002ba75fb5, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:53:36,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-12-03 10:53:36,738 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:36,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:36,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce9122c7de6f34aabd8844002ba75fb5, NAME => 'testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:53:36,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy ce9122c7de6f34aabd8844002ba75fb5 2023-12-03 10:53:36,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:36,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce9122c7de6f34aabd8844002ba75fb5 2023-12-03 10:53:36,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce9122c7de6f34aabd8844002ba75fb5 2023-12-03 10:53:36,744 INFO [StoreOpener-ce9122c7de6f34aabd8844002ba75fb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ce9122c7de6f34aabd8844002ba75fb5 2023-12-03 10:53:36,746 DEBUG [StoreOpener-ce9122c7de6f34aabd8844002ba75fb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1 2023-12-03 10:53:36,746 DEBUG [StoreOpener-ce9122c7de6f34aabd8844002ba75fb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1 2023-12-03 10:53:36,746 INFO [StoreOpener-ce9122c7de6f34aabd8844002ba75fb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce9122c7de6f34aabd8844002ba75fb5 columnFamilyName family1 2023-12-03 10:53:36,748 INFO [StoreOpener-ce9122c7de6f34aabd8844002ba75fb5-1] regionserver.HStore(310): Store=ce9122c7de6f34aabd8844002ba75fb5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:36,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5 2023-12-03 10:53:36,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5 2023-12-03 10:53:36,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce9122c7de6f34aabd8844002ba75fb5 2023-12-03 10:53:36,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:53:36,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce9122c7de6f34aabd8844002ba75fb5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75155581, jitterRate=0.11990542709827423}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:53:36,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:36,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5., pid=21, masterSystemTime=1701600816738 2023-12-03 10:53:36,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:36,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:36,758 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ce9122c7de6f34aabd8844002ba75fb5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:36,758 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701600816758"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600816758"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600816758"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600816758"}]},"ts":"1701600816758"} 2023-12-03 10:53:36,763 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=21, resume processing ppid=20 2023-12-03 10:53:36,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure ce9122c7de6f34aabd8844002ba75fb5, server=jenkins-hbase4.apache.org,44259,1701600798821 in 174 msec 2023-12-03 10:53:36,765 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2023-12-03 10:53:36,765 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=ce9122c7de6f34aabd8844002ba75fb5, ASSIGN in 334 msec 2023-12-03 10:53:36,766 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:53:36,766 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600816766"}]},"ts":"1701600816766"} 2023-12-03 10:53:36,768 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-12-03 10:53:36,771 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:53:36,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 782 msec 2023-12-03 10:53:37,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-12-03 10:53:37,101 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-12-03 10:53:37,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:37,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,138 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:37,138 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:37,139 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:53:37,139 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:37,140 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,140 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,142 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,142 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:37,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:37,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:37,142 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,142 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:37,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:37,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,143 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,143 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:53:37,143 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:37,144 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:53:37,144 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:37,144 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:37,144 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:37,144 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. started... 2023-12-03 10:53:37,145 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce9122c7de6f34aabd8844002ba75fb5 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-12-03 10:53:37,174 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d300c855327b4e67be7162587e1439d8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130d300c855327b4e67be7162587e1439d8 2023-12-03 10:53:37,579 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/f76b2e0b8b664509b377daad76135701 2023-12-03 10:53:37,587 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/f76b2e0b8b664509b377daad76135701 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/f76b2e0b8b664509b377daad76135701 2023-12-03 10:53:37,594 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/f76b2e0b8b664509b377daad76135701, entries=1000, sequenceid=5, filesize=166.0 K 2023-12-03 10:53:37,595 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ce9122c7de6f34aabd8844002ba75fb5 in 450ms, sequenceid=5, compaction requested=false 2023-12-03 10:53:37,595 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:37,597 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:37,597 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:37,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:37,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:37,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:53:37,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:53:37,599 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,599 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:37,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:37,599 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:37,599 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:37,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:37,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:53:37,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ce19cc[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:37,601 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:37,601 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,604 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:37,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:53:37,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:37,604 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,604 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:37,607 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:53:37,607 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,607 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:37,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:37,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:37,607 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:53:37,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:37,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:37,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:37,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:37,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:37,611 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:53:37,611 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:37,611 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:37,611 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,611 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:37,614 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,614 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:37,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:37,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,614 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:37,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:37,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:37,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:37,614 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:37,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,616 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:37,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:37,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:37,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:37,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:37,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:37,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:37,627 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:37,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,628 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:37,628 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:37,628 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,628 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:37,629 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,629 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,729 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:37,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:37,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:37,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:37,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,739 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:37,739 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:37,739 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:53:37,739 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:37,740 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,740 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,743 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:37,743 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:37,743 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:37,743 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:37,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,744 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,745 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:53:37,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:37,745 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:53:37,745 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:37,745 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:53:37,745 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:37,746 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:37,746 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:37,746 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. started... 2023-12-03 10:53:37,746 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce9122c7de6f34aabd8844002ba75fb5 1/1 column families, dataSize=74 B heapSize=408 B 2023-12-03 10:53:38,161 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282a080b654d28417ba2df30b35ddc2d79 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511282a080b654d28417ba2df30b35ddc2d79 2023-12-03 10:53:38,568 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/a6024ed960dd46e989b9e5d140d9a4cb 2023-12-03 10:53:38,575 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/a6024ed960dd46e989b9e5d140d9a4cb as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/a6024ed960dd46e989b9e5d140d9a4cb 2023-12-03 10:53:38,580 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/a6024ed960dd46e989b9e5d140d9a4cb, entries=1, sequenceid=9, filesize=5.0 K 2023-12-03 10:53:38,581 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ce9122c7de6f34aabd8844002ba75fb5 in 835ms, sequenceid=9, compaction requested=false 2023-12-03 10:53:38,582 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:38,582 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:53:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:53:38,584 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,584 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:38,584 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,584 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:38,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:53:38,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c5f2e2[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:38,586 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:38,586 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,588 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,588 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:38,588 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:53:38,588 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:38,588 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,588 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:38,591 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:53:38,591 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,591 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:38,591 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:53:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:38,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:38,594 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:53:38,594 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:38,594 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:38,594 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,594 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:38,596 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,596 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,596 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:38,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:38,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:38,597 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:38,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,599 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:38,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,601 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,602 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:38,602 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:38,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:38,602 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:38,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:38,602 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,602 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:38,602 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,602 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,602 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,603 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:38,603 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:38,603 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:38,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:38,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:38,703 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:38,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:38,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:38,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:38,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,711 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:38,712 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:38,712 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:53:38,712 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:38,713 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,713 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,714 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,714 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:38,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:38,715 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,715 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:38,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,716 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,716 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:53:38,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,716 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:53:38,716 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:53:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:38,717 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:38,717 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. started... 2023-12-03 10:53:38,717 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce9122c7de6f34aabd8844002ba75fb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:38,733 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011d8fc0f4fe154612ad2c333ed8c45047 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512011d8fc0f4fe154612ad2c333ed8c45047 2023-12-03 10:53:38,738 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/1ac0fba7597d4273995df16656d349df 2023-12-03 10:53:38,744 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/1ac0fba7597d4273995df16656d349df as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/1ac0fba7597d4273995df16656d349df 2023-12-03 10:53:38,749 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/1ac0fba7597d4273995df16656d349df, entries=1, sequenceid=13, filesize=4.9 K 2023-12-03 10:53:38,750 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce9122c7de6f34aabd8844002ba75fb5 in 33ms, sequenceid=13, compaction requested=true 2023-12-03 10:53:38,750 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:38,750 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:53:38,750 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:53:38,754 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:38,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:38,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:53:38,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45f16a9c[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:38,756 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:38,756 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,757 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:53:38,757 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:38,757 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,757 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:38,759 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:53:38,759 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,759 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:38,759 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:53:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:38,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:38,762 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:53:38,762 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:38,762 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:38,762 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,762 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:38,764 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,764 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:38,764 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:38,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:38,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:38,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:38,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,765 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:38,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,767 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:38,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,772 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:38,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:38,772 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:38,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:38,772 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:38,772 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,772 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:38,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:38,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-12-03 10:53:38,772 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,773 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:38,773 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:38,773 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,773 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:38,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:38,773 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,774 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,873 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:38,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:38,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:38,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:38,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,882 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:38,882 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:38,883 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:53:38,883 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:38,883 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,883 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,885 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:38,885 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:38,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:38,885 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:38,885 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,886 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,887 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:53:38,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:38,887 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:53:38,887 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:38,887 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:53:38,887 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:38,887 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:38,887 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:38,888 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. started... 2023-12-03 10:53:38,888 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce9122c7de6f34aabd8844002ba75fb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:39,304 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053e62c368b45140d8ae4b341ea27f44ad to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053e62c368b45140d8ae4b341ea27f44ad 2023-12-03 10:53:39,710 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/5d21e2f316f240c594a8c0a54b4ff4ac 2023-12-03 10:53:39,716 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/5d21e2f316f240c594a8c0a54b4ff4ac as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5d21e2f316f240c594a8c0a54b4ff4ac 2023-12-03 10:53:39,721 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5d21e2f316f240c594a8c0a54b4ff4ac, entries=1, sequenceid=17, filesize=4.9 K 2023-12-03 10:53:39,722 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce9122c7de6f34aabd8844002ba75fb5 in 834ms, sequenceid=17, compaction requested=true 2023-12-03 10:53:39,723 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:39,723 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:39,723 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:39,723 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:39,723 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,723 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:53:39,723 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:53:39,725 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,725 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:39,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:39,725 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,725 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:39,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:39,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:39,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:39,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:53:39,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39983bc0[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:39,727 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:39,727 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,729 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,729 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:39,729 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:53:39,729 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:39,729 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,729 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:39,735 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:53:39,735 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,735 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:39,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:39,735 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:53:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:39,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:39,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:39,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:39,739 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:53:39,739 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:39,739 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:39,739 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,739 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:39,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:39,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:39,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:39,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:39,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:39,741 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:39,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:39,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,743 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:39,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,745 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,745 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:39,745 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,746 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:39,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-12-03 10:53:39,746 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:39,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:39,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:39,745 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:39,746 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,746 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,747 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,747 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,747 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:39,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:39,747 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:39,847 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:39,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:39,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:39,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:39,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,855 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:39,855 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:39,856 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:53:39,856 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:39,856 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,856 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,858 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,858 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:39,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:39,858 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,858 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:39,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:39,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,859 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,860 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:53:39,860 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:53:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:53:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:39,861 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:39,861 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:39,861 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. started... 2023-12-03 10:53:39,861 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce9122c7de6f34aabd8844002ba75fb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:39,876 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228138c41e526e943afab9bbc3c79d4a46a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228138c41e526e943afab9bbc3c79d4a46a 2023-12-03 10:53:39,881 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/ca994e7b8a1247b3aa16ee429567055c 2023-12-03 10:53:39,886 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/ca994e7b8a1247b3aa16ee429567055c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/ca994e7b8a1247b3aa16ee429567055c 2023-12-03 10:53:39,892 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/ca994e7b8a1247b3aa16ee429567055c, entries=1, sequenceid=21, filesize=4.9 K 2023-12-03 10:53:39,893 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce9122c7de6f34aabd8844002ba75fb5 in 32ms, sequenceid=21, compaction requested=true 2023-12-03 10:53:39,894 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:39,894 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:39,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:39,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:39,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:53:39,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:53:39,897 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,897 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:39,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:39,898 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,898 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:39,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:39,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:39,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:39,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:53:39,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c6d5546[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:39,899 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:39,900 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,901 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,901 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:39,901 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:53:39,901 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:39,902 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,902 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:39,903 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:53:39,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:39,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:53:39,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:39,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:39,907 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:53:39,907 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:39,907 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:39,907 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,907 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:39,909 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,909 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,909 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:39,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:39,910 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,912 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:39,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,922 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,922 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:39,922 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:39,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:39,922 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:39,922 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,922 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:39,922 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,922 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,922 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:39,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:39,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:39,923 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:39,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-12-03 10:53:39,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:39,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:39,924 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:39,924 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:40,024 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:40,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:40,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:40,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:40,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,032 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:40,032 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:40,033 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:53:40,033 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:40,033 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,034 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,035 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,035 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:40,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:40,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:40,036 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,036 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:40,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:40,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,037 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:53:40,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,037 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:53:40,037 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:40,038 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:53:40,038 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:40,038 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:40,038 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:40,038 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. started... 2023-12-03 10:53:40,038 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce9122c7de6f34aabd8844002ba75fb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:40,055 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d9bc8993b6ba4fcf8dc810676f320164 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d9bc8993b6ba4fcf8dc810676f320164 2023-12-03 10:53:40,462 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/bbf979e59d5d46e195ddf425baa41e3f 2023-12-03 10:53:40,469 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/bbf979e59d5d46e195ddf425baa41e3f as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/bbf979e59d5d46e195ddf425baa41e3f 2023-12-03 10:53:40,475 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/bbf979e59d5d46e195ddf425baa41e3f, entries=1, sequenceid=25, filesize=4.9 K 2023-12-03 10:53:40,476 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce9122c7de6f34aabd8844002ba75fb5 in 438ms, sequenceid=25, compaction requested=true 2023-12-03 10:53:40,476 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:40,476 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:40,476 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:40,477 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:40,477 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,477 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:53:40,477 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:53:40,479 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,479 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:40,479 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,479 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:40,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:40,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:40,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:53:40,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6516eccb[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:40,481 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:40,481 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,482 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,483 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:40,483 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:53:40,483 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:40,483 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,483 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:40,485 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:53:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:40,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:40,485 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:53:40,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:40,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:40,489 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:53:40,489 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:40,489 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:40,489 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,489 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:40,491 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,491 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:40,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,491 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:40,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:40,491 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,493 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,496 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,496 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,496 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:40,496 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,496 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:40,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:40,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:40,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:40,496 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:40,496 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:40,497 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,497 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,497 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:40,497 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:40,497 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:40,597 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:40,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:40,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:40,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:40,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,605 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:40,605 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:40,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:53:40,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:40,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,608 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,608 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:40,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:40,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:40,609 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:40,609 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:40,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:40,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,610 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,610 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:53:40,610 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:40,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:53:40,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:40,611 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:53:40,611 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:40,611 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:40,611 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:40,611 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. started... 2023-12-03 10:53:40,611 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce9122c7de6f34aabd8844002ba75fb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:40,908 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:53:41,027 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017fe3f6d856ec4d4388765efcbce2e66b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601017fe3f6d856ec4d4388765efcbce2e66b 2023-12-03 10:53:41,433 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/7b3868985c2b48ddb04e2c3a01caea04 2023-12-03 10:53:41,440 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/7b3868985c2b48ddb04e2c3a01caea04 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/7b3868985c2b48ddb04e2c3a01caea04 2023-12-03 10:53:41,445 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/7b3868985c2b48ddb04e2c3a01caea04, entries=1, sequenceid=29, filesize=4.9 K 2023-12-03 10:53:41,446 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce9122c7de6f34aabd8844002ba75fb5 in 835ms, sequenceid=29, compaction requested=true 2023-12-03 10:53:41,446 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:41,446 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:53:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:53:41,451 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,451 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:41,452 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,452 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:41,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:41,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:53:41,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b7dcf7f[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:41,454 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:41,454 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,455 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,455 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:41,455 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:53:41,455 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:41,456 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,456 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:41,457 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:53:41,457 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,457 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:41,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:41,457 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:53:41,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:41,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:41,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:41,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:41,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:41,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:41,461 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:53:41,461 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:41,461 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:41,461 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,461 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:41,463 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,463 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:41,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:41,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,463 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:41,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,464 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:41,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:41,466 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,469 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,469 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:41,469 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:41,469 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:41,469 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:41,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:41,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:41,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:41,469 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,470 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,470 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,470 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,470 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:41,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:41,470 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:41,470 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:41,570 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:41,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:41,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:41,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:41,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,580 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:41,580 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:41,581 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:53:41,581 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:41,581 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,582 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,583 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,583 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:41,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:41,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:41,583 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:41,583 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:41,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:41,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,584 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,585 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:53:41,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:41,585 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:53:41,585 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:41,585 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:53:41,585 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:41,585 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:41,585 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:41,585 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. started... 2023-12-03 10:53:41,586 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce9122c7de6f34aabd8844002ba75fb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:41,601 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103606fbf84cfe24c5c80f9e8ce2169cd76 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103606fbf84cfe24c5c80f9e8ce2169cd76 2023-12-03 10:53:42,007 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/24507bfc9dae4a89aed877fc2ce3e048 2023-12-03 10:53:42,014 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/24507bfc9dae4a89aed877fc2ce3e048 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/24507bfc9dae4a89aed877fc2ce3e048 2023-12-03 10:53:42,019 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/24507bfc9dae4a89aed877fc2ce3e048, entries=1, sequenceid=33, filesize=4.9 K 2023-12-03 10:53:42,021 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce9122c7de6f34aabd8844002ba75fb5 in 435ms, sequenceid=33, compaction requested=true 2023-12-03 10:53:42,021 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:42,021 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:53:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:53:42,023 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,023 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:42,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:42,023 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,023 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:42,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:42,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:42,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:42,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:53:42,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5343a7eb[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:42,025 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:42,025 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,027 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:53:42,027 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,027 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:42,029 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,029 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:53:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:42,029 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:42,030 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:53:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:42,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:42,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:42,032 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:53:42,033 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:42,033 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:42,033 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,033 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:42,035 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,035 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:42,035 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:42,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:42,036 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,037 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,039 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:42,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:42,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:42,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:42,040 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:42,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:42,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:42,041 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:42,041 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:42,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:42,141 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:42,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:42,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:42,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:42,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,151 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:42,151 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:42,152 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:53:42,152 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:42,152 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,152 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,154 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:42,154 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:42,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:42,154 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:42,154 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,155 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,156 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:53:42,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:42,156 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:53:42,156 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:42,157 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:53:42,157 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:42,157 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:42,157 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:42,157 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. started... 2023-12-03 10:53:42,157 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce9122c7de6f34aabd8844002ba75fb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:42,581 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ff5c79ff2e3b40f3aa09c722a559ce0e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907ff5c79ff2e3b40f3aa09c722a559ce0e 2023-12-03 10:53:42,987 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/417a8cf65d984520ae4c6e84ad811dc7 2023-12-03 10:53:42,994 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/417a8cf65d984520ae4c6e84ad811dc7 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/417a8cf65d984520ae4c6e84ad811dc7 2023-12-03 10:53:43,000 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/417a8cf65d984520ae4c6e84ad811dc7, entries=1, sequenceid=37, filesize=4.9 K 2023-12-03 10:53:43,002 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce9122c7de6f34aabd8844002ba75fb5 in 845ms, sequenceid=37, compaction requested=true 2023-12-03 10:53:43,002 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:43,002 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:43,002 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:43,002 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:43,002 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,002 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:53:43,002 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:53:43,004 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,004 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:43,004 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,004 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:43,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:43,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:43,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:43,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:53:43,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a21fa0[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:43,006 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:43,006 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,008 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,008 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:43,008 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:53:43,008 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:43,008 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,008 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:43,010 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,010 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:53:43,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:43,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:43,010 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:43,010 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:53:43,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:43,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:43,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:43,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:43,013 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:53:43,013 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:43,013 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:43,013 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,013 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:43,017 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,017 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:43,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:43,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,017 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:43,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:43,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:43,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:43,017 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:43,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,019 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:43,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,030 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,030 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,030 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:43,030 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:43,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:43,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:43,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:43,030 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,030 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:43,030 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:43,030 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,031 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,031 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:43,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:43,031 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:43,031 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:43,131 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:43,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:43,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:43,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:43,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,140 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:43,140 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:43,140 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:53:43,140 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:43,141 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,141 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,142 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:43,142 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:43,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:43,143 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,143 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:43,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,144 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,148 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:53:43,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,148 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:53:43,148 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:43,150 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:53:43,151 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:43,151 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:43,151 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:43,151 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. started... 2023-12-03 10:53:43,151 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ce9122c7de6f34aabd8844002ba75fb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:43,173 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112091113a0b131e447eaf96afed4dd8146c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112091113a0b131e447eaf96afed4dd8146c 2023-12-03 10:53:43,580 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/855fcdd411d54460a0512c7de10e39fc 2023-12-03 10:53:43,587 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/855fcdd411d54460a0512c7de10e39fc as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/855fcdd411d54460a0512c7de10e39fc 2023-12-03 10:53:43,592 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/855fcdd411d54460a0512c7de10e39fc, entries=1, sequenceid=41, filesize=4.9 K 2023-12-03 10:53:43,594 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ce9122c7de6f34aabd8844002ba75fb5 in 443ms, sequenceid=41, compaction requested=true 2023-12-03 10:53:43,594 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:43,594 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:43,594 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:43,594 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:43,594 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,594 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:53:43,594 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:53:43,597 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:43,598 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,598 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:43,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:53:43,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2700c56b[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:43,599 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:43,599 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,601 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:43,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:53:43,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:43,601 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,601 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:43,603 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,603 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:53:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:43,603 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:43,603 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:53:43,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:43,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:43,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:43,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:43,606 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:53:43,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:43,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:43,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,606 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:43,608 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,608 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:43,608 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:43,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:43,609 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,610 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:43,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,613 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,613 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:43,613 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:43,613 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:43,613 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:43,613 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-12-03 10:53:43,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-12-03 10:53:43,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:43,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:43,613 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:43,615 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,615 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,615 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,615 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:43,615 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:43,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:43,715 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:43,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:43,718 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-12-03 10:53:43,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:53:43,721 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:53:43,722 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601423722 2023-12-03 10:53:43,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:53:43,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:53:43,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-12-03 10:53:43,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:53:43,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x5874bfd2 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:53:43,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@714517a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:53:43,730 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:53:44,571 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010320d0cb41d36f4efdae0366b024ec799b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010320d0cb41d36f4efdae0366b024ec799b 2023-12-03 10:53:44,572 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:53:44,585 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:53:44,586 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:53:44,595 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:53:44,596 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:53:44,608 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/51963a31d0da43ad80d2245983553f7e first=Optional[r5] last=Optional[r6] 2023-12-03 10:53:44,609 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/51963a31d0da43ad80d2245983553f7e}] 2023-12-03 10:53:44,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/51963a31d0da43ad80d2245983553f7e for inclusion in ce9122c7de6f34aabd8844002ba75fb5/family1 2023-12-03 10:53:44,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-12-03 10:53:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:53:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:44,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/51963a31d0da43ad80d2245983553f7e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1p1qqbduchkvc0t51abpnggkgpbvg15dhpue72gto3p7kq9q2ne0h7c8f59mhmso/family1/51963a31d0da43ad80d2245983553f7e 2023-12-03 10:53:44,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1p1qqbduchkvc0t51abpnggkgpbvg15dhpue72gto3p7kq9q2ne0h7c8f59mhmso/family1/51963a31d0da43ad80d2245983553f7e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/54542d3184424fe4b0f8450d05d789a4_SeqId_44_ 2023-12-03 10:53:44,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1p1qqbduchkvc0t51abpnggkgpbvg15dhpue72gto3p7kq9q2ne0h7c8f59mhmso/family1/51963a31d0da43ad80d2245983553f7e into ce9122c7de6f34aabd8844002ba75fb5/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/54542d3184424fe4b0f8450d05d789a4_SeqId_44_ - updating store file list. 2023-12-03 10:53:44,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/54542d3184424fe4b0f8450d05d789a4_SeqId_44_ into ce9122c7de6f34aabd8844002ba75fb5/family1 2023-12-03 10:53:44,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1p1qqbduchkvc0t51abpnggkgpbvg15dhpue72gto3p7kq9q2ne0h7c8f59mhmso/family1/51963a31d0da43ad80d2245983553f7e into ce9122c7de6f34aabd8844002ba75fb5/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/54542d3184424fe4b0f8450d05d789a4_SeqId_44_) 2023-12-03 10:53:44,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__1p1qqbduchkvc0t51abpnggkgpbvg15dhpue72gto3p7kq9q2ne0h7c8f59mhmso/family1/51963a31d0da43ad80d2245983553f7e 2023-12-03 10:53:44,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-12-03 10:53:44,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-12-03 10:53:44,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): ce9122c7de6f34aabd8844002ba75fb5/family1 is initiating minor compaction 2023-12-03 10:53:44,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5e98ebe8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:44,636 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ce9122c7de6f34aabd8844002ba75fb5/family1 in testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:44,636 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/a6024ed960dd46e989b9e5d140d9a4cb, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/1ac0fba7597d4273995df16656d349df, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5d21e2f316f240c594a8c0a54b4ff4ac, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/ca994e7b8a1247b3aa16ee429567055c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/bbf979e59d5d46e195ddf425baa41e3f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/7b3868985c2b48ddb04e2c3a01caea04, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/24507bfc9dae4a89aed877fc2ce3e048, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/417a8cf65d984520ae4c6e84ad811dc7, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/855fcdd411d54460a0512c7de10e39fc, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/54542d3184424fe4b0f8450d05d789a4_SeqId_44_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp, totalSize=49.7 K 2023-12-03 10:53:44,636 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting a6024ed960dd46e989b9e5d140d9a4cb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-12-03 10:53:44,636 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 1ac0fba7597d4273995df16656d349df, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-12-03 10:53:44,636 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 5d21e2f316f240c594a8c0a54b4ff4ac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-12-03 10:53:44,636 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting ca994e7b8a1247b3aa16ee429567055c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-12-03 10:53:44,637 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting bbf979e59d5d46e195ddf425baa41e3f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-12-03 10:53:44,637 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 7b3868985c2b48ddb04e2c3a01caea04, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-12-03 10:53:44,637 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 24507bfc9dae4a89aed877fc2ce3e048, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-12-03 10:53:44,637 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 417a8cf65d984520ae4c6e84ad811dc7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-12-03 10:53:44,637 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 855fcdd411d54460a0512c7de10e39fc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-12-03 10:53:44,637 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 54542d3184424fe4b0f8450d05d789a4_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-12-03 10:53:44,638 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:53:44,640 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:44,642 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601017fe3f6d856ec4d4388765efcbce2e66b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601017fe3f6d856ec4d4388765efcbce2e66b 2023-12-03 10:53:44,643 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103606fbf84cfe24c5c80f9e8ce2169cd76 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103606fbf84cfe24c5c80f9e8ce2169cd76 2023-12-03 10:53:44,643 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-12-03 10:53:44,643 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-12-03 10:53:44,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:53:44,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:53:44,692 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): ce9122c7de6f34aabd8844002ba75fb5#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:53:45,519 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/6103047d95ce4777b23ad647c394ce51 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/6103047d95ce4777b23ad647c394ce51 2023-12-03 10:53:45,522 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315df64cda9b454d288659b1e26427952b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512315df64cda9b454d288659b1e26427952b 2023-12-03 10:53:45,523 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:53:45,526 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ce9122c7de6f34aabd8844002ba75fb5/family1 of ce9122c7de6f34aabd8844002ba75fb5 into 6103047d95ce4777b23ad647c394ce51(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:53:45,526 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:45,527 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1701600824636; duration=0sec 2023-12-03 10:53:45,527 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:45,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/a6024ed960dd46e989b9e5d140d9a4cb, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/1ac0fba7597d4273995df16656d349df, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5d21e2f316f240c594a8c0a54b4ff4ac, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/ca994e7b8a1247b3aa16ee429567055c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/bbf979e59d5d46e195ddf425baa41e3f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/7b3868985c2b48ddb04e2c3a01caea04, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/24507bfc9dae4a89aed877fc2ce3e048, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/417a8cf65d984520ae4c6e84ad811dc7, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/855fcdd411d54460a0512c7de10e39fc, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/54542d3184424fe4b0f8450d05d789a4_SeqId_44_] to archive 2023-12-03 10:53:45,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:45,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/a6024ed960dd46e989b9e5d140d9a4cb to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/a6024ed960dd46e989b9e5d140d9a4cb 2023-12-03 10:53:45,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/1ac0fba7597d4273995df16656d349df to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/1ac0fba7597d4273995df16656d349df 2023-12-03 10:53:45,562 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/aaee24473eee464f9e7ddfb145ef6f81 first=Optional[r1] last=Optional[r4] 2023-12-03 10:53:45,562 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/aaee24473eee464f9e7ddfb145ef6f81}] 2023-12-03 10:53:45,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5d21e2f316f240c594a8c0a54b4ff4ac to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5d21e2f316f240c594a8c0a54b4ff4ac 2023-12-03 10:53:45,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/aaee24473eee464f9e7ddfb145ef6f81 for inclusion in ce9122c7de6f34aabd8844002ba75fb5/family1 2023-12-03 10:53:45,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/ca994e7b8a1247b3aa16ee429567055c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/ca994e7b8a1247b3aa16ee429567055c 2023-12-03 10:53:45,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/bbf979e59d5d46e195ddf425baa41e3f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/bbf979e59d5d46e195ddf425baa41e3f 2023-12-03 10:53:45,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/7b3868985c2b48ddb04e2c3a01caea04 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/7b3868985c2b48ddb04e2c3a01caea04 2023-12-03 10:53:45,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-12-03 10:53:45,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:53:45,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:45,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/24507bfc9dae4a89aed877fc2ce3e048 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/24507bfc9dae4a89aed877fc2ce3e048 2023-12-03 10:53:45,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/aaee24473eee464f9e7ddfb145ef6f81 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__brotk84gsfhhj0sgbu2tgm8oorbvstl8s5dp3aptfo0t95eki9gn64h9bh2ep6oi/family1/aaee24473eee464f9e7ddfb145ef6f81 2023-12-03 10:53:45,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/417a8cf65d984520ae4c6e84ad811dc7 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/417a8cf65d984520ae4c6e84ad811dc7 2023-12-03 10:53:45,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__brotk84gsfhhj0sgbu2tgm8oorbvstl8s5dp3aptfo0t95eki9gn64h9bh2ep6oi/family1/aaee24473eee464f9e7ddfb145ef6f81 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5dce40db37104fd9b36c6c3c58523988_SeqId_47_ 2023-12-03 10:53:45,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/855fcdd411d54460a0512c7de10e39fc to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/855fcdd411d54460a0512c7de10e39fc 2023-12-03 10:53:45,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__brotk84gsfhhj0sgbu2tgm8oorbvstl8s5dp3aptfo0t95eki9gn64h9bh2ep6oi/family1/aaee24473eee464f9e7ddfb145ef6f81 into ce9122c7de6f34aabd8844002ba75fb5/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5dce40db37104fd9b36c6c3c58523988_SeqId_47_ - updating store file list. 2023-12-03 10:53:45,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/54542d3184424fe4b0f8450d05d789a4_SeqId_44_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/54542d3184424fe4b0f8450d05d789a4_SeqId_44_ 2023-12-03 10:53:45,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5dce40db37104fd9b36c6c3c58523988_SeqId_47_ into ce9122c7de6f34aabd8844002ba75fb5/family1 2023-12-03 10:53:45,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__brotk84gsfhhj0sgbu2tgm8oorbvstl8s5dp3aptfo0t95eki9gn64h9bh2ep6oi/family1/aaee24473eee464f9e7ddfb145ef6f81 into ce9122c7de6f34aabd8844002ba75fb5/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5dce40db37104fd9b36c6c3c58523988_SeqId_47_) 2023-12-03 10:53:45,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__brotk84gsfhhj0sgbu2tgm8oorbvstl8s5dp3aptfo0t95eki9gn64h9bh2ep6oi/family1/aaee24473eee464f9e7ddfb145ef6f81 2023-12-03 10:53:45,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-12-03 10:53:45,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-12-03 10:53:45,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): ce9122c7de6f34aabd8844002ba75fb5/family1 is initiating minor compaction (all files) 2023-12-03 10:53:45,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@69730380; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:45,581 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ce9122c7de6f34aabd8844002ba75fb5/family1 in testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:53:45,582 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/f76b2e0b8b664509b377daad76135701, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/6103047d95ce4777b23ad647c394ce51, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5dce40db37104fd9b36c6c3c58523988_SeqId_47_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp, totalSize=178.1 K 2023-12-03 10:53:45,582 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting f76b2e0b8b664509b377daad76135701, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823227 2023-12-03 10:53:45,583 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 6103047d95ce4777b23ad647c394ce51, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223227 2023-12-03 10:53:45,583 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 5dce40db37104fd9b36c6c3c58523988_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223227 2023-12-03 10:53:45,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:53:45,584 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:45,586 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512011d8fc0f4fe154612ad2c333ed8c45047 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512011d8fc0f4fe154612ad2c333ed8c45047 2023-12-03 10:53:45,588 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053e62c368b45140d8ae4b341ea27f44ad to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053e62c368b45140d8ae4b341ea27f44ad 2023-12-03 10:53:45,589 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228138c41e526e943afab9bbc3c79d4a46a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228138c41e526e943afab9bbc3c79d4a46a 2023-12-03 10:53:45,592 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d9bc8993b6ba4fcf8dc810676f320164 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d9bc8993b6ba4fcf8dc810676f320164 2023-12-03 10:53:45,592 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-12-03 10:53:45,592 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-12-03 10:53:45,593 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:53:45,593 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:53:45,607 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): ce9122c7de6f34aabd8844002ba75fb5#family1#compaction#23 average throughput is 14.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:53:46,462 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c20a39fbaf474b89beb57715c0451e22 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130c20a39fbaf474b89beb57715c0451e22 2023-12-03 10:53:46,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:53:46,490 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/01a005e7b7df4a39a80a02a2bad92a9e first=Optional[r00] last=Optional[r8] 2023-12-03 10:53:46,491 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/01a005e7b7df4a39a80a02a2bad92a9e}] 2023-12-03 10:53:46,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/01a005e7b7df4a39a80a02a2bad92a9e for inclusion in ce9122c7de6f34aabd8844002ba75fb5/family1 2023-12-03 10:53:46,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-12-03 10:53:46,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:53:46,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:46,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/01a005e7b7df4a39a80a02a2bad92a9e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ii3ubcik8gc6qud3r8t1kc38eapvim467cs9ffjdcschp0f1vi6v7u880lkpl6s4/family1/01a005e7b7df4a39a80a02a2bad92a9e 2023-12-03 10:53:46,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ii3ubcik8gc6qud3r8t1kc38eapvim467cs9ffjdcschp0f1vi6v7u880lkpl6s4/family1/01a005e7b7df4a39a80a02a2bad92a9e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/0187256da4c34e37adb6f38b21dcf1c3_SeqId_49_ 2023-12-03 10:53:46,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ii3ubcik8gc6qud3r8t1kc38eapvim467cs9ffjdcschp0f1vi6v7u880lkpl6s4/family1/01a005e7b7df4a39a80a02a2bad92a9e into ce9122c7de6f34aabd8844002ba75fb5/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/0187256da4c34e37adb6f38b21dcf1c3_SeqId_49_ - updating store file list. 2023-12-03 10:53:46,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/0187256da4c34e37adb6f38b21dcf1c3_SeqId_49_ into ce9122c7de6f34aabd8844002ba75fb5/family1 2023-12-03 10:53:46,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ii3ubcik8gc6qud3r8t1kc38eapvim467cs9ffjdcschp0f1vi6v7u880lkpl6s4/family1/01a005e7b7df4a39a80a02a2bad92a9e into ce9122c7de6f34aabd8844002ba75fb5/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/0187256da4c34e37adb6f38b21dcf1c3_SeqId_49_) 2023-12-03 10:53:46,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ii3ubcik8gc6qud3r8t1kc38eapvim467cs9ffjdcschp0f1vi6v7u880lkpl6s4/family1/01a005e7b7df4a39a80a02a2bad92a9e 2023-12-03 10:53:46,509 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:53:46,509 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:46,511 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112091113a0b131e447eaf96afed4dd8146c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112091113a0b131e447eaf96afed4dd8146c 2023-12-03 10:53:46,513 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511282a080b654d28417ba2df30b35ddc2d79 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511282a080b654d28417ba2df30b35ddc2d79 2023-12-03 10:53:46,514 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130d300c855327b4e67be7162587e1439d8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130d300c855327b4e67be7162587e1439d8 2023-12-03 10:53:46,514 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-12-03 10:53:46,514 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-12-03 10:53:46,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:53:46,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:53:46,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:53:46,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:53:46,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:53:46,516 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:53:46,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7980 sec 2023-12-03 10:53:46,624 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=258 (was 251) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/cluster_b90589ee-8101-48f7-b85d-53817d79ec5a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1cd99299-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55776 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55952 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55714 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1cd99299-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1cd99299-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55908 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55874 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55840 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55854 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1cd99299-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-232089398_17 at /127.0.0.1:55820 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55856 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/f78907dd6fba41aab2703b20ee5eef3f java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62442@0x5874bfd2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/606735526.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55760 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:35632 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55804 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/cluster_b90589ee-8101-48f7-b85d-53817d79ec5a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62442@0x5874bfd2-SendThread(127.0.0.1:62442) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55784 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55834 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1cd99299-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62442@0x5874bfd2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: hconnection-0x1cd99299-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1688977958_17 at /127.0.0.1:55862 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-232089398_17 at /127.0.0.1:55740 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1cd99299-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=635 (was 619) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 242), ProcessCount=172 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=3414 (was 3432) 2023-12-03 10:53:46,635 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=258, OpenFileDescriptor=635, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=172, AvailableMemoryMB=3413 2023-12-03 10:53:46,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-12-03 10:53:46,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:46,640 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:53:46,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-12-03 10:53:46,641 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:53:46,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-12-03 10:53:46,642 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f 2023-12-03 10:53:46,643 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f empty. 2023-12-03 10:53:46,644 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f 2023-12-03 10:53:46,644 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-12-03 10:53:46,655 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-12-03 10:53:46,656 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => c7b4c05e53c817658d496c4380ef7b0f, NAME => 'testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:53:46,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-12-03 10:53:46,845 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/.tmp/family1/f78907dd6fba41aab2703b20ee5eef3f as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/f78907dd6fba41aab2703b20ee5eef3f 2023-12-03 10:53:46,852 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ce9122c7de6f34aabd8844002ba75fb5/family1 of ce9122c7de6f34aabd8844002ba75fb5 into f78907dd6fba41aab2703b20ee5eef3f(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:53:46,852 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:53:46,852 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1701600825581; duration=1sec 2023-12-03 10:53:46,852 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:46,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-12-03 10:53:46,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/f76b2e0b8b664509b377daad76135701, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/6103047d95ce4777b23ad647c394ce51, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5dce40db37104fd9b36c6c3c58523988_SeqId_47_] to archive 2023-12-03 10:53:46,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:46,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/f76b2e0b8b664509b377daad76135701 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/f76b2e0b8b664509b377daad76135701 2023-12-03 10:53:46,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/6103047d95ce4777b23ad647c394ce51 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/6103047d95ce4777b23ad647c394ce51 2023-12-03 10:53:46,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5dce40db37104fd9b36c6c3c58523988_SeqId_47_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/family1/5dce40db37104fd9b36c6c3c58523988_SeqId_47_ 2023-12-03 10:53:47,067 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:47,067 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing c7b4c05e53c817658d496c4380ef7b0f, disabling compactions & flushes 2023-12-03 10:53:47,067 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:47,067 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:47,067 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. after waiting 0 ms 2023-12-03 10:53:47,067 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:47,067 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:47,067 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:47,070 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:53:47,071 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701600827071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600827071"}]},"ts":"1701600827071"} 2023-12-03 10:53:47,073 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-03 10:53:47,074 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:53:47,074 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600827074"}]},"ts":"1701600827074"} 2023-12-03 10:53:47,075 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-12-03 10:53:47,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c7b4c05e53c817658d496c4380ef7b0f, ASSIGN}] 2023-12-03 10:53:47,081 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c7b4c05e53c817658d496c4380ef7b0f, ASSIGN 2023-12-03 10:53:47,082 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c7b4c05e53c817658d496c4380ef7b0f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:53:47,233 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=c7b4c05e53c817658d496c4380ef7b0f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:47,233 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701600827233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600827233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600827233"}]},"ts":"1701600827233"} 2023-12-03 10:53:47,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure c7b4c05e53c817658d496c4380ef7b0f, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:53:47,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-12-03 10:53:47,388 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:47,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:47,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7b4c05e53c817658d496c4380ef7b0f, NAME => 'testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:53:47,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy c7b4c05e53c817658d496c4380ef7b0f 2023-12-03 10:53:47,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:47,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c7b4c05e53c817658d496c4380ef7b0f 2023-12-03 10:53:47,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c7b4c05e53c817658d496c4380ef7b0f 2023-12-03 10:53:47,393 INFO [StoreOpener-c7b4c05e53c817658d496c4380ef7b0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c7b4c05e53c817658d496c4380ef7b0f 2023-12-03 10:53:47,394 DEBUG [StoreOpener-c7b4c05e53c817658d496c4380ef7b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1 2023-12-03 10:53:47,394 DEBUG [StoreOpener-c7b4c05e53c817658d496c4380ef7b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1 2023-12-03 10:53:47,395 INFO [StoreOpener-c7b4c05e53c817658d496c4380ef7b0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7b4c05e53c817658d496c4380ef7b0f columnFamilyName family1 2023-12-03 10:53:47,396 INFO [StoreOpener-c7b4c05e53c817658d496c4380ef7b0f-1] regionserver.HStore(310): Store=c7b4c05e53c817658d496c4380ef7b0f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:47,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f 2023-12-03 10:53:47,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f 2023-12-03 10:53:47,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c7b4c05e53c817658d496c4380ef7b0f 2023-12-03 10:53:47,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:53:47,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c7b4c05e53c817658d496c4380ef7b0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75032450, jitterRate=0.11807063221931458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:53:47,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:47,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f., pid=25, masterSystemTime=1701600827388 2023-12-03 10:53:47,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:47,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:47,406 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=c7b4c05e53c817658d496c4380ef7b0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:47,407 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701600827406"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600827406"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600827406"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600827406"}]},"ts":"1701600827406"} 2023-12-03 10:53:47,410 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2023-12-03 10:53:47,410 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure c7b4c05e53c817658d496c4380ef7b0f, server=jenkins-hbase4.apache.org,44259,1701600798821 in 172 msec 2023-12-03 10:53:47,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=23 2023-12-03 10:53:47,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=c7b4c05e53c817658d496c4380ef7b0f, ASSIGN in 330 msec 2023-12-03 10:53:47,413 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:53:47,414 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600827413"}]},"ts":"1701600827413"} 2023-12-03 10:53:47,415 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-12-03 10:53:47,418 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:53:47,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 781 msec 2023-12-03 10:53:47,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-12-03 10:53:47,746 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-12-03 10:53:47,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:47,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:47,774 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:47,774 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:47,774 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:53:47,774 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:47,775 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:47,775 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:47,777 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:47,777 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:47,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:47,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:47,777 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:47,777 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:47,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:47,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:47,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:47,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:47,778 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:47,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:47,778 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:53:47,779 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:47,779 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:53:47,779 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:47,779 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:47,779 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:47,779 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. started... 2023-12-03 10:53:47,780 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7b4c05e53c817658d496c4380ef7b0f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-12-03 10:53:48,205 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130af5f684768954043b4a3621f56abbb07 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130af5f684768954043b4a3621f56abbb07 2023-12-03 10:53:48,609 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/c47583e5685340738b3b876fe7b2e460 2023-12-03 10:53:48,615 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/c47583e5685340738b3b876fe7b2e460 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c47583e5685340738b3b876fe7b2e460 2023-12-03 10:53:48,620 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c47583e5685340738b3b876fe7b2e460, entries=1000, sequenceid=5, filesize=165.1 K 2023-12-03 10:53:48,621 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c7b4c05e53c817658d496c4380ef7b0f in 841ms, sequenceid=5, compaction requested=false 2023-12-03 10:53:48,621 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:48,622 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:48,622 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:53:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:53:48,625 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,625 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:48,625 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,625 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:48,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:53:48,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6243f0c3[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:48,627 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:48,627 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,628 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,629 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:48,629 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:53:48,629 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:48,629 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,629 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:48,630 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:53:48,630 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:48,630 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,630 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:53:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:48,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:48,633 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:53:48,633 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:48,633 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:48,633 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,633 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:48,636 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,636 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:48,636 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:48,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:48,636 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,638 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,641 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,641 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,641 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,641 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:48,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:48,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:48,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-12-03 10:53:48,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:48,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:48,641 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:48,641 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,641 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:48,641 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:48,642 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:48,641 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:48,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:48,642 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,642 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,742 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:48,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:48,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:48,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:48,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,750 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:48,750 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:48,750 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:53:48,750 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:48,750 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,750 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,752 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,752 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:48,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:48,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:48,752 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:48,752 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:48,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:48,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,753 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,754 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:53:48,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:48,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:53:48,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:48,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:53:48,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:48,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:48,754 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:48,754 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. started... 2023-12-03 10:53:48,754 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7b4c05e53c817658d496c4380ef7b0f 1/1 column families, dataSize=74 B heapSize=408 B 2023-12-03 10:53:49,169 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128def2fbf4b5de4ec4a58807ec43f52afd to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128def2fbf4b5de4ec4a58807ec43f52afd 2023-12-03 10:53:49,175 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/c760f58701d94af09816a5fddeeced54 2023-12-03 10:53:49,181 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/c760f58701d94af09816a5fddeeced54 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c760f58701d94af09816a5fddeeced54 2023-12-03 10:53:49,188 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c760f58701d94af09816a5fddeeced54, entries=1, sequenceid=9, filesize=5.0 K 2023-12-03 10:53:49,189 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c7b4c05e53c817658d496c4380ef7b0f in 435ms, sequenceid=9, compaction requested=false 2023-12-03 10:53:49,189 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:49,189 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:49,189 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:49,189 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:49,189 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,189 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:53:49,189 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:53:49,196 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,196 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:49,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:49,196 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,196 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:49,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:49,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:49,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:49,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:53:49,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cf17f9f[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:49,198 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:49,198 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,200 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:53:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:49,200 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,200 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:49,202 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,202 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:53:49,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:49,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:49,202 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:49,202 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:53:49,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:49,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:49,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:49,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:49,205 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:53:49,205 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:49,205 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:49,205 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,205 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:49,207 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,207 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,207 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:49,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:49,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:49,208 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:49,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,210 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,214 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,214 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,214 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:49,214 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:49,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:49,214 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:49,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:49,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:49,214 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,215 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,215 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:49,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:49,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-12-03 10:53:49,215 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:49,214 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:49,215 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:49,215 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,315 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:49,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:49,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:49,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:49,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,323 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:49,323 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:49,323 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:53:49,323 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:49,323 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,323 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,325 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,325 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:49,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:49,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:49,326 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,326 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:49,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:49,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,326 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,327 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:53:49,327 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,327 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:53:49,327 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:49,327 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:53:49,327 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:49,327 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:49,327 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:49,327 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. started... 2023-12-03 10:53:49,327 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7b4c05e53c817658d496c4380ef7b0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:49,743 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bee042133bd049f2b1adece584b44c70 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201bee042133bd049f2b1adece584b44c70 2023-12-03 10:53:49,748 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/ca8a8bf0afb542a1a198368db01645de 2023-12-03 10:53:49,754 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/ca8a8bf0afb542a1a198368db01645de as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/ca8a8bf0afb542a1a198368db01645de 2023-12-03 10:53:49,758 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/ca8a8bf0afb542a1a198368db01645de, entries=1, sequenceid=13, filesize=4.9 K 2023-12-03 10:53:49,759 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7b4c05e53c817658d496c4380ef7b0f in 432ms, sequenceid=13, compaction requested=true 2023-12-03 10:53:49,760 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:49,760 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:49,760 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:49,760 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:49,760 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,760 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:53:49,760 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:53:49,762 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,762 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:49,762 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,762 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@494b2abe[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:49,764 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:49,764 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,765 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,765 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:49,765 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:53:49,765 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:49,765 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,765 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:49,772 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,772 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:53:49,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:49,773 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:49,773 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:53:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:49,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:49,775 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:53:49,775 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:49,775 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:49,775 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,775 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:49,777 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,777 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:49,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,777 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:49,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:49,778 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:49,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,779 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,781 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,782 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,782 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:49,782 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:49,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:49,782 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:49,782 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:49,782 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:49,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:49,782 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:49,782 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:49,782 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,782 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:49,782 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:49,883 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:49,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:49,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:49,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:49,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,890 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:49,890 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:49,890 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:53:49,890 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:49,891 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,891 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,892 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,893 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:49,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:49,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:49,893 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:49,893 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:49,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,894 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,894 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:53:49,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:53:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:53:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:49,894 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:49,895 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. started... 2023-12-03 10:53:49,895 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7b4c05e53c817658d496c4380ef7b0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:50,312 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ad98d259f58742179d2e4296b9e5f37b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ad98d259f58742179d2e4296b9e5f37b 2023-12-03 10:53:50,719 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/8510bf8a097846caba781e4591b90190 2023-12-03 10:53:50,724 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/8510bf8a097846caba781e4591b90190 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/8510bf8a097846caba781e4591b90190 2023-12-03 10:53:50,729 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/8510bf8a097846caba781e4591b90190, entries=1, sequenceid=17, filesize=4.9 K 2023-12-03 10:53:50,730 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7b4c05e53c817658d496c4380ef7b0f in 835ms, sequenceid=17, compaction requested=true 2023-12-03 10:53:50,730 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:50,730 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:50,730 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:50,730 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:50,730 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,730 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:53:50,730 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:53:50,734 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,734 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:50,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:50,734 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:50,734 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:50,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:50,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:50,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:53:50,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68419561[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:50,736 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:50,736 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,738 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,738 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:50,738 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,738 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:50,738 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:53:50,738 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:50,740 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:53:50,740 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,740 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:50,740 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:53:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:50,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:50,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:50,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:50,744 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:53:50,744 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:50,744 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:50,744 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,744 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:50,746 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,746 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,746 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:50,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:50,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:50,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:50,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:50,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:50,747 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,749 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,755 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,755 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:50,755 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:50,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:50,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-12-03 10:53:50,755 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:50,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:50,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:50,755 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:50,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:50,756 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,756 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,756 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,756 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,756 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,756 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:50,756 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:50,856 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:50,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:50,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:50,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:50,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,864 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:50,864 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:50,864 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:53:50,864 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:50,865 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,865 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,867 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,867 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:50,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:50,867 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:50,867 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,868 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,869 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:53:50,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:50,869 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:53:50,869 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:50,869 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:53:50,869 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:50,869 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:50,869 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:50,869 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. started... 2023-12-03 10:53:50,869 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7b4c05e53c817658d496c4380ef7b0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:51,285 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c680e562ff754c178902cf854441b2e0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c680e562ff754c178902cf854441b2e0 2023-12-03 10:53:51,691 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/4fa9ab57c15048b0bd2bdb64a253441e 2023-12-03 10:53:51,697 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/4fa9ab57c15048b0bd2bdb64a253441e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/4fa9ab57c15048b0bd2bdb64a253441e 2023-12-03 10:53:51,702 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/4fa9ab57c15048b0bd2bdb64a253441e, entries=1, sequenceid=21, filesize=4.9 K 2023-12-03 10:53:51,703 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7b4c05e53c817658d496c4380ef7b0f in 834ms, sequenceid=21, compaction requested=true 2023-12-03 10:53:51,703 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:51,703 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:51,703 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:51,703 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:51,703 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,703 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:53:51,703 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:53:51,705 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,705 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:51,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:51,705 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:51,705 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:51,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:51,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:51,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:53:51,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15f9b542[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:51,707 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:51,707 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,709 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,709 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:51,709 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:53:51,709 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:51,709 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,709 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:51,711 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:53:51,711 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,711 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:51,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:51,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:51,711 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:53:51,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:51,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:51,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:51,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:51,714 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:53:51,714 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:51,714 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:51,714 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,714 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:51,716 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,716 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:51,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:51,716 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:51,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:51,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:51,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:51,716 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:51,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,718 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:51,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,720 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,721 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:51,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:51,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:51,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:51,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:51,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:51,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:51,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,721 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,721 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:51,721 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:51,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:51,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:51,821 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:51,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:51,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:51,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:51,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,829 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:51,829 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:51,829 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:53:51,829 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:51,829 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,829 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,830 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:51,830 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:51,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:51,831 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:51,831 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:51,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:51,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,832 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,832 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:53:51,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:51,832 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:53:51,832 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:51,832 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:53:51,832 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:51,832 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:51,832 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:51,832 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. started... 2023-12-03 10:53:51,832 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7b4c05e53c817658d496c4380ef7b0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:52,248 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231eb18205c45be4917b0c9b02c9a830eb9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231eb18205c45be4917b0c9b02c9a830eb9 2023-12-03 10:53:52,655 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/f398195e24564a55a49769fbd8f7ec3e 2023-12-03 10:53:52,661 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/f398195e24564a55a49769fbd8f7ec3e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f398195e24564a55a49769fbd8f7ec3e 2023-12-03 10:53:52,666 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f398195e24564a55a49769fbd8f7ec3e, entries=1, sequenceid=25, filesize=4.9 K 2023-12-03 10:53:52,667 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7b4c05e53c817658d496c4380ef7b0f in 835ms, sequenceid=25, compaction requested=true 2023-12-03 10:53:52,667 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:52,667 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:52,667 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:52,667 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:52,667 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,667 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:53:52,667 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:53:52,670 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,671 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:52,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:53:52,672 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:52,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32d33de5[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:52,672 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,673 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,674 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:52,674 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:53:52,674 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:52,674 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,674 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:52,675 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,675 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:53:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:52,675 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:52,675 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:53:52,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:52,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:52,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:52,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:52,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:52,678 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:53:52,678 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:52,678 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:52,678 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,678 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:52,680 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,680 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,680 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:52,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:52,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:52,681 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,682 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:52,686 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:52,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-12-03 10:53:52,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:52,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:52,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:52,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:52,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:52,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:52,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:52,686 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:52,687 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:52,787 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:52,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:52,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:52,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:52,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,795 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:52,795 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:52,795 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:53:52,795 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:52,796 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,796 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,797 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:52,797 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:52,798 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:52,798 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:52,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:52,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,799 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,799 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:53:52,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:52,799 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:53:52,799 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:52,799 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:53:52,799 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:52,799 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:52,799 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:52,799 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. started... 2023-12-03 10:53:52,799 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7b4c05e53c817658d496c4380ef7b0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:52,926 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:53:53,214 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f7ab9451661c4b43a777749d3399635f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f7ab9451661c4b43a777749d3399635f 2023-12-03 10:53:53,620 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/bb0e0d4b88e445d9a612d62528076a4b 2023-12-03 10:53:53,626 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/bb0e0d4b88e445d9a612d62528076a4b as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bb0e0d4b88e445d9a612d62528076a4b 2023-12-03 10:53:53,630 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bb0e0d4b88e445d9a612d62528076a4b, entries=1, sequenceid=29, filesize=4.9 K 2023-12-03 10:53:53,631 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7b4c05e53c817658d496c4380ef7b0f in 832ms, sequenceid=29, compaction requested=true 2023-12-03 10:53:53,631 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:53,631 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:53,631 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:53,631 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:53,631 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,631 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:53:53,631 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:53:53,634 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,634 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:53,634 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,634 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:53,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:53:53,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22ddffdb[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:53,636 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:53,636 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,637 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,637 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:53,637 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:53:53,637 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:53,637 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,637 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:53,639 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:53:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:53:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:53,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:53,641 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:53:53,642 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:53,642 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:53,642 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,642 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:53,651 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,651 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:53,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:53,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,651 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:53,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:53,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:53,652 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:53,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,653 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:53,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,656 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,656 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,656 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:53,656 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,656 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:53,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-12-03 10:53:53,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:53,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:53,656 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:53,656 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:53,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:53,656 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,656 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,656 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,656 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:53,657 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:53,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:53,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:53,757 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:53,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:53,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:53,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:53,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,764 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:53,764 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:53,764 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:53:53,764 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:53,765 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,765 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,766 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:53,766 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:53,767 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:53,767 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:53,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,768 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,768 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:53:53,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:53,768 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:53:53,768 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:53,768 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:53:53,768 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:53,768 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:53,768 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:53,768 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. started... 2023-12-03 10:53:53,769 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7b4c05e53c817658d496c4380ef7b0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:54,183 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103094a703f5bce4a1b949519b89f51ad8f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103094a703f5bce4a1b949519b89f51ad8f 2023-12-03 10:53:54,589 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/3974633def8d4d14a34112592b9b2d01 2023-12-03 10:53:54,595 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/3974633def8d4d14a34112592b9b2d01 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/3974633def8d4d14a34112592b9b2d01 2023-12-03 10:53:54,600 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/3974633def8d4d14a34112592b9b2d01, entries=1, sequenceid=33, filesize=4.9 K 2023-12-03 10:53:54,601 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7b4c05e53c817658d496c4380ef7b0f in 832ms, sequenceid=33, compaction requested=true 2023-12-03 10:53:54,601 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:54,601 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:54,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:54,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:54,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:53:54,601 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:53:54,603 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,603 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:54,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:54,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:53:54,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46538c7c[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:54,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:54,606 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,608 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,608 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:54,608 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:53:54,608 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:54,608 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,608 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:54,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:53:54,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:54,610 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:53:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:54,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:54,613 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:53:54,613 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:54,613 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:54,613 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,613 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:54,615 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,615 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:54,615 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:54,615 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:54,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:54,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,617 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:54,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,619 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,620 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:54,620 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:54,620 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:54,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:54,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:54,620 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-12-03 10:53:54,620 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:54,620 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,620 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:54,620 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:54,620 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,620 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,620 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:54,720 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:54,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:54,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:54,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:54,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,728 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:54,728 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:54,728 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:53:54,728 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:54,728 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,728 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,730 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:54,730 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:54,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:54,731 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:54,731 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:54,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:54,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,732 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,732 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:53:54,732 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:54,732 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:53:54,732 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:54,732 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:53:54,732 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:54,732 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:54,733 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:54,733 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. started... 2023-12-03 10:53:54,733 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7b4c05e53c817658d496c4380ef7b0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:54,746 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070b746258f9ac487c88680754f6a76e64 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509070b746258f9ac487c88680754f6a76e64 2023-12-03 10:53:55,152 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/1d4ef694a78d47e9ac2acb2bc61dd8c9 2023-12-03 10:53:55,158 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/1d4ef694a78d47e9ac2acb2bc61dd8c9 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1d4ef694a78d47e9ac2acb2bc61dd8c9 2023-12-03 10:53:55,163 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1d4ef694a78d47e9ac2acb2bc61dd8c9, entries=1, sequenceid=37, filesize=4.9 K 2023-12-03 10:53:55,164 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7b4c05e53c817658d496c4380ef7b0f in 431ms, sequenceid=37, compaction requested=true 2023-12-03 10:53:55,164 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:55,164 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:55,164 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:55,164 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:55,164 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,164 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:53:55,164 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:53:55,166 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,166 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:55,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:55,167 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,167 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:55,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:53:55,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ed87251[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:55,168 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:55,168 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,169 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,170 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:55,170 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:53:55,170 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,170 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:55,170 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:55,171 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,171 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:53:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,172 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:55,172 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:53:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:55,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:55,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:55,174 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:53:55,175 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:55,175 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:55,175 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,175 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:55,177 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,177 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:55,177 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:55,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:55,178 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,179 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:55,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,182 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,182 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,182 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,182 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,182 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:55,183 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,183 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:55,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:55,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:55,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:55,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:55,183 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,183 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:55,183 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,183 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:55,183 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:55,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:55,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:55,283 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:55,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:55,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:55,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:53:55,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,290 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:55,290 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:55,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:53:55,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:53:55,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,293 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:55,293 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:55,293 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:55,293 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,294 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,294 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:53:55,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:55,294 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:53:55,294 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:55,294 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:53:55,295 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:53:55,295 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:55,295 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:55,295 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. started... 2023-12-03 10:53:55,295 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c7b4c05e53c817658d496c4380ef7b0f 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:53:55,709 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112079be616631e24ff29d46d57a45e25f89 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112079be616631e24ff29d46d57a45e25f89 2023-12-03 10:53:56,115 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/fe19b02cabad48e48edb62aea1c2c4ca 2023-12-03 10:53:56,121 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/fe19b02cabad48e48edb62aea1c2c4ca as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/fe19b02cabad48e48edb62aea1c2c4ca 2023-12-03 10:53:56,126 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/fe19b02cabad48e48edb62aea1c2c4ca, entries=1, sequenceid=41, filesize=4.9 K 2023-12-03 10:53:56,127 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c7b4c05e53c817658d496c4380ef7b0f in 832ms, sequenceid=41, compaction requested=true 2023-12-03 10:53:56,127 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:56,127 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:56,127 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:53:56,127 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:53:56,127 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,127 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:53:56,127 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:53:56,129 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,129 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:56,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:56,129 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,130 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:53:56,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:56,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:56,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:56,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:53:56,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@354f487a[Count = 0] remaining members to acquire global barrier 2023-12-03 10:53:56,131 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:53:56,131 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,136 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:53:56,136 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:53:56,136 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:53:56,136 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,136 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:53:56,137 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:53:56,137 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,137 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:56,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:56,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:56,137 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:53:56,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:56,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:56,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:56,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:53:56,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:53:56,140 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:53:56,140 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:53:56,140 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:53:56,140 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,140 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:53:56,142 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,142 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:53:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:53:56,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,142 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:53:56,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:56,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:56,142 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:53:56,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,144 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:53:56,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:56,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:56,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:56,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:53:56,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-12-03 10:53:56,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:53:56,147 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:53:56,147 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:56,147 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,147 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,147 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:53:56,147 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:53:56,147 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:53:56,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:53:56,247 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:53:56,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:53:56,250 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-12-03 10:53:56,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:53:56,253 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:53:56,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:53:56,254 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601436254 2023-12-03 10:53:56,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-12-03 10:53:56,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-12-03 10:53:56,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:53:56,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x21a3838f to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:53:56,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7802304d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:53:56,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:53:56,712 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035445ad269244413a85ec77f45976b53b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601035445ad269244413a85ec77f45976b53b 2023-12-03 10:53:56,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:53:56,727 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:53:56,729 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:53:56,735 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:53:56,737 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:53:56,746 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8883262c96ec4a9d96f878aac3165b32 first=Optional[r3] last=Optional[r6] 2023-12-03 10:53:56,747 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8883262c96ec4a9d96f878aac3165b32}] 2023-12-03 10:53:56,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8883262c96ec4a9d96f878aac3165b32 for inclusion in c7b4c05e53c817658d496c4380ef7b0f/family1 2023-12-03 10:53:56,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-12-03 10:53:56,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:53:56,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:56,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8883262c96ec4a9d96f878aac3165b32 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1tg2ofjrr9gom2i1m8dhap227bheure7mvoonjajdpq4viapcf226dh2gjecqpcc/family1/8883262c96ec4a9d96f878aac3165b32 2023-12-03 10:53:56,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1tg2ofjrr9gom2i1m8dhap227bheure7mvoonjajdpq4viapcf226dh2gjecqpcc/family1/8883262c96ec4a9d96f878aac3165b32 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1136535b72124c55b40fe1d498d60341_SeqId_44_ 2023-12-03 10:53:56,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1tg2ofjrr9gom2i1m8dhap227bheure7mvoonjajdpq4viapcf226dh2gjecqpcc/family1/8883262c96ec4a9d96f878aac3165b32 into c7b4c05e53c817658d496c4380ef7b0f/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1136535b72124c55b40fe1d498d60341_SeqId_44_ - updating store file list. 2023-12-03 10:53:56,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1136535b72124c55b40fe1d498d60341_SeqId_44_ into c7b4c05e53c817658d496c4380ef7b0f/family1 2023-12-03 10:53:56,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1tg2ofjrr9gom2i1m8dhap227bheure7mvoonjajdpq4viapcf226dh2gjecqpcc/family1/8883262c96ec4a9d96f878aac3165b32 into c7b4c05e53c817658d496c4380ef7b0f/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1136535b72124c55b40fe1d498d60341_SeqId_44_) 2023-12-03 10:53:56,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1tg2ofjrr9gom2i1m8dhap227bheure7mvoonjajdpq4viapcf226dh2gjecqpcc/family1/8883262c96ec4a9d96f878aac3165b32 2023-12-03 10:53:56,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-12-03 10:53:56,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-12-03 10:53:56,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): c7b4c05e53c817658d496c4380ef7b0f/family1 is initiating minor compaction 2023-12-03 10:53:56,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5c7a673e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:56,773 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c7b4c05e53c817658d496c4380ef7b0f/family1 in testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:56,773 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c760f58701d94af09816a5fddeeced54, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/ca8a8bf0afb542a1a198368db01645de, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/8510bf8a097846caba781e4591b90190, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/4fa9ab57c15048b0bd2bdb64a253441e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f398195e24564a55a49769fbd8f7ec3e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bb0e0d4b88e445d9a612d62528076a4b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/3974633def8d4d14a34112592b9b2d01, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1d4ef694a78d47e9ac2acb2bc61dd8c9, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/fe19b02cabad48e48edb62aea1c2c4ca, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1136535b72124c55b40fe1d498d60341_SeqId_44_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp, totalSize=50.0 K 2023-12-03 10:53:56,773 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting c760f58701d94af09816a5fddeeced54, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-12-03 10:53:56,773 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting ca8a8bf0afb542a1a198368db01645de, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-12-03 10:53:56,774 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 8510bf8a097846caba781e4591b90190, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-12-03 10:53:56,774 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 4fa9ab57c15048b0bd2bdb64a253441e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-12-03 10:53:56,774 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting f398195e24564a55a49769fbd8f7ec3e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-12-03 10:53:56,774 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting bb0e0d4b88e445d9a612d62528076a4b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-12-03 10:53:56,774 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 3974633def8d4d14a34112592b9b2d01, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-12-03 10:53:56,774 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 1d4ef694a78d47e9ac2acb2bc61dd8c9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-12-03 10:53:56,774 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting fe19b02cabad48e48edb62aea1c2c4ca, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-12-03 10:53:56,774 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 1136535b72124c55b40fe1d498d60341_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-12-03 10:53:56,776 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:53:56,777 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:56,780 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c680e562ff754c178902cf854441b2e0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c680e562ff754c178902cf854441b2e0 2023-12-03 10:53:56,782 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231eb18205c45be4917b0c9b02c9a830eb9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231eb18205c45be4917b0c9b02c9a830eb9 2023-12-03 10:53:56,784 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f7ab9451661c4b43a777749d3399635f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f7ab9451661c4b43a777749d3399635f 2023-12-03 10:53:56,785 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103094a703f5bce4a1b949519b89f51ad8f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103094a703f5bce4a1b949519b89f51ad8f 2023-12-03 10:53:56,786 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-12-03 10:53:56,786 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-12-03 10:53:56,786 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:53:56,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:53:56,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:53:56,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:53:56,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:53:56,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:53:56,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:53:56,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:53:56,817 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): c7b4c05e53c817658d496c4380ef7b0f#family1#compaction#34 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:53:57,633 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051465f90cdb984d4a815cff5218420f05 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051465f90cdb984d4a815cff5218420f05 2023-12-03 10:53:57,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:53:57,638 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/bdebe4df4ed64fa2b3150f980e765cd9 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bdebe4df4ed64fa2b3150f980e765cd9 2023-12-03 10:53:57,644 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c7b4c05e53c817658d496c4380ef7b0f/family1 of c7b4c05e53c817658d496c4380ef7b0f into bdebe4df4ed64fa2b3150f980e765cd9(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:53:57,645 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:57,645 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1701600836773; duration=0sec 2023-12-03 10:53:57,645 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:57,662 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d3d1db47a0304ffd9cf5cb03ad2b279d first=Optional[r1] last=Optional[r2] 2023-12-03 10:53:57,662 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d3d1db47a0304ffd9cf5cb03ad2b279d}] 2023-12-03 10:53:57,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d3d1db47a0304ffd9cf5cb03ad2b279d for inclusion in c7b4c05e53c817658d496c4380ef7b0f/family1 2023-12-03 10:53:57,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-12-03 10:53:57,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:53:57,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:57,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d3d1db47a0304ffd9cf5cb03ad2b279d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nsds9s7e6krh2q9lslmp18ihcmmn4d151icoll7147tprjin30h3dhg6jgubcji8/family1/d3d1db47a0304ffd9cf5cb03ad2b279d 2023-12-03 10:53:57,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nsds9s7e6krh2q9lslmp18ihcmmn4d151icoll7147tprjin30h3dhg6jgubcji8/family1/d3d1db47a0304ffd9cf5cb03ad2b279d as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f8f2777748ec470da8d355db3c7f995c_SeqId_47_ 2023-12-03 10:53:57,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nsds9s7e6krh2q9lslmp18ihcmmn4d151icoll7147tprjin30h3dhg6jgubcji8/family1/d3d1db47a0304ffd9cf5cb03ad2b279d into c7b4c05e53c817658d496c4380ef7b0f/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f8f2777748ec470da8d355db3c7f995c_SeqId_47_ - updating store file list. 2023-12-03 10:53:57,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f8f2777748ec470da8d355db3c7f995c_SeqId_47_ into c7b4c05e53c817658d496c4380ef7b0f/family1 2023-12-03 10:53:57,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nsds9s7e6krh2q9lslmp18ihcmmn4d151icoll7147tprjin30h3dhg6jgubcji8/family1/d3d1db47a0304ffd9cf5cb03ad2b279d into c7b4c05e53c817658d496c4380ef7b0f/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f8f2777748ec470da8d355db3c7f995c_SeqId_47_) 2023-12-03 10:53:57,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nsds9s7e6krh2q9lslmp18ihcmmn4d151icoll7147tprjin30h3dhg6jgubcji8/family1/d3d1db47a0304ffd9cf5cb03ad2b279d 2023-12-03 10:53:57,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-12-03 10:53:57,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-12-03 10:53:57,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): c7b4c05e53c817658d496c4380ef7b0f/family1 is initiating minor compaction (all files) 2023-12-03 10:53:57,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2223af3e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:57,679 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c7b4c05e53c817658d496c4380ef7b0f/family1 in testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:53:57,679 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c47583e5685340738b3b876fe7b2e460, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bdebe4df4ed64fa2b3150f980e765cd9, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f8f2777748ec470da8d355db3c7f995c_SeqId_47_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp, totalSize=176.8 K 2023-12-03 10:53:57,680 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting c47583e5685340738b3b876fe7b2e460, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823227 2023-12-03 10:53:57,680 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting bdebe4df4ed64fa2b3150f980e765cd9, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223227 2023-12-03 10:53:57,681 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting f8f2777748ec470da8d355db3c7f995c_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223227 2023-12-03 10:53:57,681 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:53:57,682 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:57,683 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201bee042133bd049f2b1adece584b44c70 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201bee042133bd049f2b1adece584b44c70 2023-12-03 10:53:57,685 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ad98d259f58742179d2e4296b9e5f37b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ad98d259f58742179d2e4296b9e5f37b 2023-12-03 10:53:57,685 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-12-03 10:53:57,685 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-12-03 10:53:57,685 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:53:57,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:53:57,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:53:57,686 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:53:57,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4350 sec 2023-12-03 10:53:57,701 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): c7b4c05e53c817658d496c4380ef7b0f#family1#compaction#35 average throughput is 14.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:53:57,724 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/.tmp/family1/1e95ec53cd844c73a57ecc9c1f3fd918 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1e95ec53cd844c73a57ecc9c1f3fd918 2023-12-03 10:53:57,732 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c7b4c05e53c817658d496c4380ef7b0f/family1 of c7b4c05e53c817658d496c4380ef7b0f into 1e95ec53cd844c73a57ecc9c1f3fd918(size=166.8 K), total size for store is 166.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:53:57,732 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:53:57,732 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1701600837679; duration=0sec 2023-12-03 10:53:57,732 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:53:57,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c47583e5685340738b3b876fe7b2e460, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c760f58701d94af09816a5fddeeced54, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/ca8a8bf0afb542a1a198368db01645de, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/8510bf8a097846caba781e4591b90190, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/4fa9ab57c15048b0bd2bdb64a253441e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f398195e24564a55a49769fbd8f7ec3e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bb0e0d4b88e445d9a612d62528076a4b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/3974633def8d4d14a34112592b9b2d01, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1d4ef694a78d47e9ac2acb2bc61dd8c9, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/fe19b02cabad48e48edb62aea1c2c4ca, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bdebe4df4ed64fa2b3150f980e765cd9, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1136535b72124c55b40fe1d498d60341_SeqId_44_, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f8f2777748ec470da8d355db3c7f995c_SeqId_47_] to archive 2023-12-03 10:53:57,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:53:57,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c47583e5685340738b3b876fe7b2e460 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c47583e5685340738b3b876fe7b2e460 2023-12-03 10:53:57,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c760f58701d94af09816a5fddeeced54 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/c760f58701d94af09816a5fddeeced54 2023-12-03 10:53:57,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/ca8a8bf0afb542a1a198368db01645de to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/ca8a8bf0afb542a1a198368db01645de 2023-12-03 10:53:57,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/8510bf8a097846caba781e4591b90190 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/8510bf8a097846caba781e4591b90190 2023-12-03 10:53:57,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/4fa9ab57c15048b0bd2bdb64a253441e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/4fa9ab57c15048b0bd2bdb64a253441e 2023-12-03 10:53:57,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f398195e24564a55a49769fbd8f7ec3e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f398195e24564a55a49769fbd8f7ec3e 2023-12-03 10:53:57,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bb0e0d4b88e445d9a612d62528076a4b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bb0e0d4b88e445d9a612d62528076a4b 2023-12-03 10:53:57,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/3974633def8d4d14a34112592b9b2d01 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/3974633def8d4d14a34112592b9b2d01 2023-12-03 10:53:57,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1d4ef694a78d47e9ac2acb2bc61dd8c9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1d4ef694a78d47e9ac2acb2bc61dd8c9 2023-12-03 10:53:57,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/fe19b02cabad48e48edb62aea1c2c4ca to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/fe19b02cabad48e48edb62aea1c2c4ca 2023-12-03 10:53:57,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bdebe4df4ed64fa2b3150f980e765cd9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/bdebe4df4ed64fa2b3150f980e765cd9 2023-12-03 10:53:57,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1136535b72124c55b40fe1d498d60341_SeqId_44_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/1136535b72124c55b40fe1d498d60341_SeqId_44_ 2023-12-03 10:53:57,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f8f2777748ec470da8d355db3c7f995c_SeqId_47_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/family1/f8f2777748ec470da8d355db3c7f995c_SeqId_47_ 2023-12-03 10:53:57,801 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=256 (was 258), OpenFileDescriptor=643 (was 635) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 229) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=3309 (was 3413) 2023-12-03 10:53:57,812 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=256, OpenFileDescriptor=643, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=172, AvailableMemoryMB=3308 2023-12-03 10:53:57,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-12-03 10:53:57,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-12-03 10:53:57,818 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:53:57,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-12-03 10:53:57,819 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:53:57,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-12-03 10:53:57,821 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:53:57,821 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed 2023-12-03 10:53:57,821 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:53:57,822 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142 empty. 2023-12-03 10:53:57,822 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed empty. 2023-12-03 10:53:57,822 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d empty. 2023-12-03 10:53:57,822 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:53:57,822 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed 2023-12-03 10:53:57,824 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:53:57,824 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-12-03 10:53:57,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-12-03 10:53:58,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-12-03 10:53:58,234 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-12-03 10:53:58,236 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6f6f0dabc1a4ce1265e8b9909953c142, NAME => 'testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:53:58,236 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 94e4474ff1bcc350b17fcf6b47380e5d, NAME => 'testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:53:58,236 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 49a8cf4e23954387a072460722ce1bed, NAME => 'testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:53:58,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-12-03 10:53:58,646 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:58,647 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 94e4474ff1bcc350b17fcf6b47380e5d, disabling compactions & flushes 2023-12-03 10:53:58,647 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:53:58,647 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:53:58,647 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. after waiting 0 ms 2023-12-03 10:53:58,647 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:53:58,647 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:53:58,647 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 94e4474ff1bcc350b17fcf6b47380e5d: 2023-12-03 10:53:58,651 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:58,651 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 6f6f0dabc1a4ce1265e8b9909953c142, disabling compactions & flushes 2023-12-03 10:53:58,651 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:53:58,651 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:53:58,651 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. after waiting 0 ms 2023-12-03 10:53:58,651 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:53:58,651 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:53:58,651 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 6f6f0dabc1a4ce1265e8b9909953c142: 2023-12-03 10:53:58,651 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:58,652 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 49a8cf4e23954387a072460722ce1bed, disabling compactions & flushes 2023-12-03 10:53:58,652 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:53:58,652 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:53:58,652 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. after waiting 0 ms 2023-12-03 10:53:58,652 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:53:58,652 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:53:58,652 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 49a8cf4e23954387a072460722ce1bed: 2023-12-03 10:53:58,654 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:53:58,655 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701600838655"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600838655"}]},"ts":"1701600838655"} 2023-12-03 10:53:58,655 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701600838655"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600838655"}]},"ts":"1701600838655"} 2023-12-03 10:53:58,655 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701600838655"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600838655"}]},"ts":"1701600838655"} 2023-12-03 10:53:58,658 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-12-03 10:53:58,659 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:53:58,659 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600838659"}]},"ts":"1701600838659"} 2023-12-03 10:53:58,661 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-12-03 10:53:58,665 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6f6f0dabc1a4ce1265e8b9909953c142, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=49a8cf4e23954387a072460722ce1bed, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=94e4474ff1bcc350b17fcf6b47380e5d, ASSIGN}] 2023-12-03 10:53:58,666 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=49a8cf4e23954387a072460722ce1bed, ASSIGN 2023-12-03 10:53:58,666 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6f6f0dabc1a4ce1265e8b9909953c142, ASSIGN 2023-12-03 10:53:58,666 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=94e4474ff1bcc350b17fcf6b47380e5d, ASSIGN 2023-12-03 10:53:58,667 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6f6f0dabc1a4ce1265e8b9909953c142, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:53:58,667 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=49a8cf4e23954387a072460722ce1bed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:53:58,667 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=94e4474ff1bcc350b17fcf6b47380e5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:53:58,819 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6f6f0dabc1a4ce1265e8b9909953c142, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:58,819 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=94e4474ff1bcc350b17fcf6b47380e5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:58,819 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=49a8cf4e23954387a072460722ce1bed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:58,819 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701600838819"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600838819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600838819"}]},"ts":"1701600838819"} 2023-12-03 10:53:58,819 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701600838819"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600838819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600838819"}]},"ts":"1701600838819"} 2023-12-03 10:53:58,819 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701600838819"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600838819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600838819"}]},"ts":"1701600838819"} 2023-12-03 10:53:58,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 6f6f0dabc1a4ce1265e8b9909953c142, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:53:58,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 94e4474ff1bcc350b17fcf6b47380e5d, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:53:58,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 49a8cf4e23954387a072460722ce1bed, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:53:58,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-12-03 10:53:58,974 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:58,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:53:58,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 49a8cf4e23954387a072460722ce1bed, NAME => 'testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed.', STARTKEY => '1', ENDKEY => '2'} 2023-12-03 10:53:58,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 49a8cf4e23954387a072460722ce1bed 2023-12-03 10:53:58,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:58,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 49a8cf4e23954387a072460722ce1bed 2023-12-03 10:53:58,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 49a8cf4e23954387a072460722ce1bed 2023-12-03 10:53:58,979 INFO [StoreOpener-49a8cf4e23954387a072460722ce1bed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 49a8cf4e23954387a072460722ce1bed 2023-12-03 10:53:58,981 DEBUG [StoreOpener-49a8cf4e23954387a072460722ce1bed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed/family1 2023-12-03 10:53:58,981 DEBUG [StoreOpener-49a8cf4e23954387a072460722ce1bed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed/family1 2023-12-03 10:53:58,981 INFO [StoreOpener-49a8cf4e23954387a072460722ce1bed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49a8cf4e23954387a072460722ce1bed columnFamilyName family1 2023-12-03 10:53:58,982 INFO [StoreOpener-49a8cf4e23954387a072460722ce1bed-1] regionserver.HStore(310): Store=49a8cf4e23954387a072460722ce1bed/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:58,983 INFO [StoreOpener-49a8cf4e23954387a072460722ce1bed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 49a8cf4e23954387a072460722ce1bed 2023-12-03 10:53:58,984 DEBUG [StoreOpener-49a8cf4e23954387a072460722ce1bed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed/family2 2023-12-03 10:53:58,984 DEBUG [StoreOpener-49a8cf4e23954387a072460722ce1bed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed/family2 2023-12-03 10:53:58,984 INFO [StoreOpener-49a8cf4e23954387a072460722ce1bed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49a8cf4e23954387a072460722ce1bed columnFamilyName family2 2023-12-03 10:53:58,986 INFO [StoreOpener-49a8cf4e23954387a072460722ce1bed-1] regionserver.HStore(310): Store=49a8cf4e23954387a072460722ce1bed/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:58,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed 2023-12-03 10:53:58,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed 2023-12-03 10:53:58,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:53:58,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 49a8cf4e23954387a072460722ce1bed 2023-12-03 10:53:58,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:53:58,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 49a8cf4e23954387a072460722ce1bed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74131668, jitterRate=0.1046479344367981}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:53:58,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 49a8cf4e23954387a072460722ce1bed: 2023-12-03 10:53:58,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed., pid=33, masterSystemTime=1701600838974 2023-12-03 10:53:58,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:53:58,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:53:58,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:53:58,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f6f0dabc1a4ce1265e8b9909953c142, NAME => 'testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142.', STARTKEY => '', ENDKEY => '1'} 2023-12-03 10:53:58,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:53:58,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:58,995 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=49a8cf4e23954387a072460722ce1bed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:58,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:53:58,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:53:58,996 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701600838995"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600838995"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600838995"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600838995"}]},"ts":"1701600838995"} 2023-12-03 10:53:58,997 INFO [StoreOpener-6f6f0dabc1a4ce1265e8b9909953c142-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:53:58,998 DEBUG [StoreOpener-6f6f0dabc1a4ce1265e8b9909953c142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142/family1 2023-12-03 10:53:58,998 DEBUG [StoreOpener-6f6f0dabc1a4ce1265e8b9909953c142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142/family1 2023-12-03 10:53:58,999 INFO [StoreOpener-6f6f0dabc1a4ce1265e8b9909953c142-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f6f0dabc1a4ce1265e8b9909953c142 columnFamilyName family1 2023-12-03 10:53:58,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=29 2023-12-03 10:53:58,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 49a8cf4e23954387a072460722ce1bed, server=jenkins-hbase4.apache.org,44259,1701600798821 in 175 msec 2023-12-03 10:53:59,000 INFO [StoreOpener-6f6f0dabc1a4ce1265e8b9909953c142-1] regionserver.HStore(310): Store=6f6f0dabc1a4ce1265e8b9909953c142/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:59,000 INFO [StoreOpener-6f6f0dabc1a4ce1265e8b9909953c142-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:53:59,001 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=49a8cf4e23954387a072460722ce1bed, ASSIGN in 334 msec 2023-12-03 10:53:59,002 DEBUG [StoreOpener-6f6f0dabc1a4ce1265e8b9909953c142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142/family2 2023-12-03 10:53:59,002 DEBUG [StoreOpener-6f6f0dabc1a4ce1265e8b9909953c142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142/family2 2023-12-03 10:53:59,003 INFO [StoreOpener-6f6f0dabc1a4ce1265e8b9909953c142-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f6f0dabc1a4ce1265e8b9909953c142 columnFamilyName family2 2023-12-03 10:53:59,004 INFO [StoreOpener-6f6f0dabc1a4ce1265e8b9909953c142-1] regionserver.HStore(310): Store=6f6f0dabc1a4ce1265e8b9909953c142/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:59,027 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:53:59,028 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0092e441 to 127.0.0.1:62442 2023-12-03 10:53:59,028 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:53:59,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:53:59,029 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:53:59,029 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ef0abd8 to 127.0.0.1:62442 2023-12-03 10:53:59,029 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:53:59,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:53:59,029 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:53:59,029 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5874bfd2 to 127.0.0.1:62442 2023-12-03 10:53:59,029 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:53:59,029 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:53:59,030 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21a3838f to 127.0.0.1:62442 2023-12-03 10:53:59,030 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:53:59,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:53:59,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:53:59,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:53:59,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f6f0dabc1a4ce1265e8b9909953c142; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69745392, jitterRate=0.03928732872009277}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:53:59,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f6f0dabc1a4ce1265e8b9909953c142: 2023-12-03 10:53:59,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142., pid=31, masterSystemTime=1701600838974 2023-12-03 10:53:59,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:53:59,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:53:59,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:53:59,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 94e4474ff1bcc350b17fcf6b47380e5d, NAME => 'testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d.', STARTKEY => '2', ENDKEY => ''} 2023-12-03 10:53:59,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:53:59,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:53:59,041 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6f6f0dabc1a4ce1265e8b9909953c142, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:59,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:53:59,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:53:59,041 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701600839040"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600839040"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600839040"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600839040"}]},"ts":"1701600839040"} 2023-12-03 10:53:59,042 INFO [StoreOpener-94e4474ff1bcc350b17fcf6b47380e5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:53:59,043 DEBUG [StoreOpener-94e4474ff1bcc350b17fcf6b47380e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1 2023-12-03 10:53:59,043 DEBUG [StoreOpener-94e4474ff1bcc350b17fcf6b47380e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1 2023-12-03 10:53:59,044 INFO [StoreOpener-94e4474ff1bcc350b17fcf6b47380e5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94e4474ff1bcc350b17fcf6b47380e5d columnFamilyName family1 2023-12-03 10:53:59,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=31, resume processing ppid=28 2023-12-03 10:53:59,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 6f6f0dabc1a4ce1265e8b9909953c142, server=jenkins-hbase4.apache.org,44259,1701600798821 in 221 msec 2023-12-03 10:53:59,045 INFO [StoreOpener-94e4474ff1bcc350b17fcf6b47380e5d-1] regionserver.HStore(310): Store=94e4474ff1bcc350b17fcf6b47380e5d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:59,045 INFO [StoreOpener-94e4474ff1bcc350b17fcf6b47380e5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:53:59,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6f6f0dabc1a4ce1265e8b9909953c142, ASSIGN in 380 msec 2023-12-03 10:53:59,047 DEBUG [StoreOpener-94e4474ff1bcc350b17fcf6b47380e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family2 2023-12-03 10:53:59,047 DEBUG [StoreOpener-94e4474ff1bcc350b17fcf6b47380e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family2 2023-12-03 10:53:59,047 INFO [StoreOpener-94e4474ff1bcc350b17fcf6b47380e5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94e4474ff1bcc350b17fcf6b47380e5d columnFamilyName family2 2023-12-03 10:53:59,048 INFO [StoreOpener-94e4474ff1bcc350b17fcf6b47380e5d-1] regionserver.HStore(310): Store=94e4474ff1bcc350b17fcf6b47380e5d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:53:59,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:53:59,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:53:59,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:53:59,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:53:59,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:53:59,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 94e4474ff1bcc350b17fcf6b47380e5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73733131, jitterRate=0.09870927035808563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:53:59,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 94e4474ff1bcc350b17fcf6b47380e5d: 2023-12-03 10:53:59,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d., pid=32, masterSystemTime=1701600838974 2023-12-03 10:53:59,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:53:59,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:53:59,058 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=94e4474ff1bcc350b17fcf6b47380e5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:59,058 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701600839058"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600839058"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600839058"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600839058"}]},"ts":"1701600839058"} 2023-12-03 10:53:59,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=30 2023-12-03 10:53:59,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 94e4474ff1bcc350b17fcf6b47380e5d, server=jenkins-hbase4.apache.org,44259,1701600798821 in 239 msec 2023-12-03 10:53:59,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=30, resume processing ppid=27 2023-12-03 10:53:59,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=94e4474ff1bcc350b17fcf6b47380e5d, ASSIGN in 397 msec 2023-12-03 10:53:59,065 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:53:59,065 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600839065"}]},"ts":"1701600839065"} 2023-12-03 10:53:59,066 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-12-03 10:53:59,069 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:53:59,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2540 sec 2023-12-03 10:53:59,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-12-03 10:53:59,924 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-12-03 10:53:59,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:53:59,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-12-03 10:53:59,935 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-12-03 10:53:59,935 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:59,935 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-12-03 10:53:59,935 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-12-03 10:53:59,936 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:53:59,936 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-12-03 10:53:59,938 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:53:59,938 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:59,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:53:59,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:53:59,938 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:53:59,938 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:53:59,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-12-03 10:53:59,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:53:59,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:53:59,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-12-03 10:53:59,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-12-03 10:53:59,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-12-03 10:53:59,940 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-12-03 10:53:59,940 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:53:59,940 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-12-03 10:53:59,941 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:53:59,941 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. started... 2023-12-03 10:53:59,945 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 49a8cf4e23954387a072460722ce1bed: 2023-12-03 10:53:59,945 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:53:59,945 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:53:59,945 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:53:59,945 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. started... 2023-12-03 10:53:59,945 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:53:59,945 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. started... 2023-12-03 10:53:59,945 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:53:59,946 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 94e4474ff1bcc350b17fcf6b47380e5d 2/2 column families, dataSize=48 B heapSize=632 B 2023-12-03 10:53:59,946 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6f6f0dabc1a4ce1265e8b9909953c142: 2023-12-03 10:53:59,946 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:53:59,946 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:53:59,946 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:54:00,361 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203a154fb7ebcac4e1684a3b095be54d9b0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231203a154fb7ebcac4e1684a3b095be54d9b0 2023-12-03 10:54:00,767 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/.tmp/family1/f6b6ef6c2ca140898984c3ef6a049fd8 2023-12-03 10:54:00,772 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/.tmp/family1/f6b6ef6c2ca140898984c3ef6a049fd8 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/f6b6ef6c2ca140898984c3ef6a049fd8 2023-12-03 10:54:00,777 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/f6b6ef6c2ca140898984c3ef6a049fd8, entries=1, sequenceid=5, filesize=4.9 K 2023-12-03 10:54:00,778 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 94e4474ff1bcc350b17fcf6b47380e5d in 832ms, sequenceid=5, compaction requested=false 2023-12-03 10:54:00,778 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-12-03 10:54:00,779 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 94e4474ff1bcc350b17fcf6b47380e5d: 2023-12-03 10:54:00,779 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:54:00,779 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:54:00,779 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:54:00,779 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,779 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-12-03 10:54:00,779 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-12-03 10:54:00,781 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,781 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:00,782 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,782 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:00,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:00,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-12-03 10:54:00,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78a14a2f[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:00,784 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-12-03 10:54:00,784 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,786 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,787 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-12-03 10:54:00,787 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-12-03 10:54:00,787 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:00,787 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,787 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:00,788 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,788 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-12-03 10:54:00,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:00,789 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:00,789 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-12-03 10:54:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:00,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:00,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-12-03 10:54:00,791 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-12-03 10:54:00,791 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:00,791 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:00,791 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,791 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:00,793 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,793 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,793 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:00,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:00,794 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:00,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,795 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:00,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,798 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,798 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,798 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,798 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:00,798 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:00,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-12-03 10:54:00,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:00,798 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:00,798 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,798 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:00,799 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:00,799 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,799 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:00,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:00,799 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:00,899 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:00,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:00,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:00,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:00,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,906 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-12-03 10:54:00,906 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:00,906 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-12-03 10:54:00,906 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-12-03 10:54:00,907 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,907 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,909 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:00,909 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:00,910 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:00,910 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,911 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,911 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-12-03 10:54:00,911 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:00,911 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-12-03 10:54:00,911 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:00,911 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-12-03 10:54:00,911 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:54:00,911 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. started... 2023-12-03 10:54:00,911 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:54:00,911 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:54:00,911 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 49a8cf4e23954387a072460722ce1bed: 2023-12-03 10:54:00,911 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:54:00,911 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:00,912 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. started... 2023-12-03 10:54:00,911 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. started... 2023-12-03 10:54:00,912 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:54:00,912 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:54:00,912 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 94e4474ff1bcc350b17fcf6b47380e5d 2/2 column families, dataSize=90 B heapSize=752 B 2023-12-03 10:54:00,912 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6f6f0dabc1a4ce1265e8b9909953c142: 2023-12-03 10:54:00,912 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:54:00,912 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:54:01,331 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203bcb96c8223e44fa489667d31ed1637b4 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231203bcb96c8223e44fa489667d31ed1637b4 2023-12-03 10:54:01,736 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/.tmp/family1/19ff3e70f0c546058da72cc1575b6f99 2023-12-03 10:54:01,742 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/.tmp/family1/19ff3e70f0c546058da72cc1575b6f99 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/19ff3e70f0c546058da72cc1575b6f99 2023-12-03 10:54:01,746 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/19ff3e70f0c546058da72cc1575b6f99, entries=2, sequenceid=9, filesize=5.0 K 2023-12-03 10:54:01,747 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 94e4474ff1bcc350b17fcf6b47380e5d in 835ms, sequenceid=9, compaction requested=false 2023-12-03 10:54:01,748 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 94e4474ff1bcc350b17fcf6b47380e5d: 2023-12-03 10:54:01,748 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:54:01,748 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:54:01,748 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:54:01,748 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,749 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-12-03 10:54:01,749 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-12-03 10:54:01,750 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,750 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:01,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:01,751 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,751 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:01,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:01,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:01,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:01,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-12-03 10:54:01,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@224b092b[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:01,752 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-12-03 10:54:01,752 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,754 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-12-03 10:54:01,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-12-03 10:54:01,754 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:01,754 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,754 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:01,756 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,756 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-12-03 10:54:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:01,756 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:01,756 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-12-03 10:54:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:01,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:01,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:01,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:01,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-12-03 10:54:01,758 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-12-03 10:54:01,758 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:01,758 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:01,758 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,758 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:01,768 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,768 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:01,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,768 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:01,769 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:01,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,771 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:01,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,774 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,774 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:01,774 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:01,774 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,774 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:01,775 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:01,775 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,775 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,775 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,775 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:01,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:01,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-12-03 10:54:01,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:01,775 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:01,775 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:01,876 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:01,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:01,883 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-12-03 10:54:01,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-12-03 10:54:01,886 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-12-03 10:54:01,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:01,887 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601441887 2023-12-03 10:54:01,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:54:01,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-12-03 10:54:01,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-12-03 10:54:01,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x685b3547 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:54:01,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@132f059, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:54:01,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231203 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-12-03 10:54:02,327 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312031091249731e64ee5a7ec610ed6d658e8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202312031091249731e64ee5a7ec610ed6d658e8 2023-12-03 10:54:02,328 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231203 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-12-03 10:54:02,341 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:54:02,342 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:54:02,350 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:54:02,352 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:54:02,362 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231203/family1/3d6ceced0a2b498d8ef445fdb7517dde first=Optional[k0] last=Optional[k1] 2023-12-03 10:54:02,363 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231203/family1/3d6ceced0a2b498d8ef445fdb7517dde}] 2023-12-03 10:54:02,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231203/family1/3d6ceced0a2b498d8ef445fdb7517dde for inclusion in 94e4474ff1bcc350b17fcf6b47380e5d/family1 2023-12-03 10:54:02,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-12-03 10:54:02,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first=2 last= 2023-12-03 10:54:02,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 94e4474ff1bcc350b17fcf6b47380e5d: 2023-12-03 10:54:02,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231203/family1/3d6ceced0a2b498d8ef445fdb7517dde to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testScannerOnBulkLoadRefHFiles__v7hm9ts85gha81f91t3n99d8f9acdhuqj4kv1l4lb22d3833kjicq6qhjdeio70h/family1/3d6ceced0a2b498d8ef445fdb7517dde 2023-12-03 10:54:02,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testScannerOnBulkLoadRefHFiles__v7hm9ts85gha81f91t3n99d8f9acdhuqj4kv1l4lb22d3833kjicq6qhjdeio70h/family1/3d6ceced0a2b498d8ef445fdb7517dde as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/402d44e9a34a4b01833c334474489737_SeqId_12_ 2023-12-03 10:54:02,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testScannerOnBulkLoadRefHFiles__v7hm9ts85gha81f91t3n99d8f9acdhuqj4kv1l4lb22d3833kjicq6qhjdeio70h/family1/3d6ceced0a2b498d8ef445fdb7517dde into 94e4474ff1bcc350b17fcf6b47380e5d/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/402d44e9a34a4b01833c334474489737_SeqId_12_ - updating store file list. 2023-12-03 10:54:02,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/402d44e9a34a4b01833c334474489737_SeqId_12_ into 94e4474ff1bcc350b17fcf6b47380e5d/family1 2023-12-03 10:54:02,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testScannerOnBulkLoadRefHFiles__v7hm9ts85gha81f91t3n99d8f9acdhuqj4kv1l4lb22d3833kjicq6qhjdeio70h/family1/3d6ceced0a2b498d8ef445fdb7517dde into 94e4474ff1bcc350b17fcf6b47380e5d/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/402d44e9a34a4b01833c334474489737_SeqId_12_) 2023-12-03 10:54:02,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testScannerOnBulkLoadRefHFiles__v7hm9ts85gha81f91t3n99d8f9acdhuqj4kv1l4lb22d3833kjicq6qhjdeio70h/family1/3d6ceced0a2b498d8ef445fdb7517dde 2023-12-03 10:54:02,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-12-03 10:54:02,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-12-03 10:54:02,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): 94e4474ff1bcc350b17fcf6b47380e5d/family1 is initiating minor compaction (all files) 2023-12-03 10:54:02,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@11488bcc; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:02,382 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 94e4474ff1bcc350b17fcf6b47380e5d/family1 in testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:54:02,383 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/f6b6ef6c2ca140898984c3ef6a049fd8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/19ff3e70f0c546058da72cc1575b6f99, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/402d44e9a34a4b01833c334474489737_SeqId_12_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/.tmp, totalSize=15.1 K 2023-12-03 10:54:02,383 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting f6b6ef6c2ca140898984c3ef6a049fd8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600839924 2023-12-03 10:54:02,384 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 19ff3e70f0c546058da72cc1575b6f99, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600839924 2023-12-03 10:54:02,384 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 402d44e9a34a4b01833c334474489737_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600839924 2023-12-03 10:54:02,385 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231203 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-12-03 10:54:02,385 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:02,387 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231203a154fb7ebcac4e1684a3b095be54d9b0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231203a154fb7ebcac4e1684a3b095be54d9b0 2023-12-03 10:54:02,389 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231203bcb96c8223e44fa489667d31ed1637b4 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231203bcb96c8223e44fa489667d31ed1637b4 2023-12-03 10:54:02,389 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-12-03 10:54:02,389 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231203' 2023-12-03 10:54:02,390 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231203 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-12-03 10:54:02,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-12-03 10:54:02,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:02,391 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-12-03 10:54:02,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 506 msec 2023-12-03 10:54:02,398 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 94e4474ff1bcc350b17fcf6b47380e5d#family1#compaction#38 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:54:02,425 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=249 (was 256), OpenFileDescriptor=612 (was 643), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 254), ProcessCount=172 (was 172), AvailableMemoryMB=3264 (was 3308) 2023-12-03 10:54:02,440 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249, OpenFileDescriptor=612, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=172, AvailableMemoryMB=3263 2023-12-03 10:54:02,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-12-03 10:54:02,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:02,446 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:54:02,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-12-03 10:54:02,447 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:54:02,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-12-03 10:54:02,448 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c 2023-12-03 10:54:02,448 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c empty. 2023-12-03 10:54:02,449 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c 2023-12-03 10:54:02,449 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-12-03 10:54:02,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-12-03 10:54:02,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-12-03 10:54:02,857 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-12-03 10:54:02,859 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6569c89c13b80b87af2e4ef76aca532c, NAME => 'testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:54:03,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-12-03 10:54:03,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:03,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 6569c89c13b80b87af2e4ef76aca532c, disabling compactions & flushes 2023-12-03 10:54:03,265 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:03,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:03,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. after waiting 0 ms 2023-12-03 10:54:03,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:03,265 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:03,265 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:03,268 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:54:03,269 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701600843269"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600843269"}]},"ts":"1701600843269"} 2023-12-03 10:54:03,270 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-03 10:54:03,271 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:54:03,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600843271"}]},"ts":"1701600843271"} 2023-12-03 10:54:03,272 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-12-03 10:54:03,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6569c89c13b80b87af2e4ef76aca532c, ASSIGN}] 2023-12-03 10:54:03,277 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6569c89c13b80b87af2e4ef76aca532c, ASSIGN 2023-12-03 10:54:03,278 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6569c89c13b80b87af2e4ef76aca532c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:54:03,429 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=6569c89c13b80b87af2e4ef76aca532c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:03,429 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701600843429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600843429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600843429"}]},"ts":"1701600843429"} 2023-12-03 10:54:03,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 6569c89c13b80b87af2e4ef76aca532c, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:03,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-12-03 10:54:03,583 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:03,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:03,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6569c89c13b80b87af2e4ef76aca532c, NAME => 'testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:54:03,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 6569c89c13b80b87af2e4ef76aca532c 2023-12-03 10:54:03,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:03,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6569c89c13b80b87af2e4ef76aca532c 2023-12-03 10:54:03,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6569c89c13b80b87af2e4ef76aca532c 2023-12-03 10:54:03,587 INFO [StoreOpener-6569c89c13b80b87af2e4ef76aca532c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6569c89c13b80b87af2e4ef76aca532c 2023-12-03 10:54:03,589 DEBUG [StoreOpener-6569c89c13b80b87af2e4ef76aca532c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1 2023-12-03 10:54:03,589 DEBUG [StoreOpener-6569c89c13b80b87af2e4ef76aca532c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1 2023-12-03 10:54:03,589 INFO [StoreOpener-6569c89c13b80b87af2e4ef76aca532c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6569c89c13b80b87af2e4ef76aca532c columnFamilyName family1 2023-12-03 10:54:03,591 INFO [StoreOpener-6569c89c13b80b87af2e4ef76aca532c-1] regionserver.HStore(310): Store=6569c89c13b80b87af2e4ef76aca532c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:03,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c 2023-12-03 10:54:03,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c 2023-12-03 10:54:03,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6569c89c13b80b87af2e4ef76aca532c 2023-12-03 10:54:03,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:54:03,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6569c89c13b80b87af2e4ef76aca532c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62156874, jitterRate=-0.07379040122032166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:54:03,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:03,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c., pid=37, masterSystemTime=1701600843583 2023-12-03 10:54:03,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:03,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:03,601 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=6569c89c13b80b87af2e4ef76aca532c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:03,601 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701600843601"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600843601"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600843601"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600843601"}]},"ts":"1701600843601"} 2023-12-03 10:54:03,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2023-12-03 10:54:03,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 6569c89c13b80b87af2e4ef76aca532c, server=jenkins-hbase4.apache.org,44259,1701600798821 in 171 msec 2023-12-03 10:54:03,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2023-12-03 10:54:03,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6569c89c13b80b87af2e4ef76aca532c, ASSIGN in 328 msec 2023-12-03 10:54:03,606 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:54:03,606 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600843606"}]},"ts":"1701600843606"} 2023-12-03 10:54:03,607 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-12-03 10:54:03,610 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:54:03,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1670 sec 2023-12-03 10:54:03,618 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/.tmp/family1/57859fd4015147a1bc0876cf1ac639fb as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/57859fd4015147a1bc0876cf1ac639fb 2023-12-03 10:54:03,623 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 94e4474ff1bcc350b17fcf6b47380e5d/family1 of 94e4474ff1bcc350b17fcf6b47380e5d into 57859fd4015147a1bc0876cf1ac639fb(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:54:03,623 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 94e4474ff1bcc350b17fcf6b47380e5d: 2023-12-03 10:54:03,623 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1701600842382; duration=1sec 2023-12-03 10:54:03,623 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:03,648 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/f6b6ef6c2ca140898984c3ef6a049fd8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/19ff3e70f0c546058da72cc1575b6f99, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/402d44e9a34a4b01833c334474489737_SeqId_12_] to archive 2023-12-03 10:54:03,649 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:03,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/f6b6ef6c2ca140898984c3ef6a049fd8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/f6b6ef6c2ca140898984c3ef6a049fd8 2023-12-03 10:54:03,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/19ff3e70f0c546058da72cc1575b6f99 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/19ff3e70f0c546058da72cc1575b6f99 2023-12-03 10:54:03,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/402d44e9a34a4b01833c334474489737_SeqId_12_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/family1/402d44e9a34a4b01833c334474489737_SeqId_12_ 2023-12-03 10:54:04,505 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:54:04,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-12-03 10:54:04,552 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-12-03 10:54:04,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:04,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,574 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:04,574 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:04,574 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:54:04,574 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:54:04,574 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,574 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,577 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:04,577 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:04,577 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,577 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,578 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:54:04,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:04,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:54:04,579 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:04,579 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:04,579 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:04,579 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. started... 2023-12-03 10:54:04,579 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6569c89c13b80b87af2e4ef76aca532c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-12-03 10:54:04,597 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305410fea2041d42ab98f94d432ccdf792 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511305410fea2041d42ab98f94d432ccdf792 2023-12-03 10:54:04,600 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/f0617eaa06f343b78f7107ba68b3f980 2023-12-03 10:54:04,604 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/f0617eaa06f343b78f7107ba68b3f980 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/f0617eaa06f343b78f7107ba68b3f980 2023-12-03 10:54:04,608 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/f0617eaa06f343b78f7107ba68b3f980, entries=1000, sequenceid=5, filesize=165.1 K 2023-12-03 10:54:04,609 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6569c89c13b80b87af2e4ef76aca532c in 30ms, sequenceid=5, compaction requested=false 2023-12-03 10:54:04,609 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:04,610 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:04,610 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:04,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:04,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:04,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:54:04,610 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:54:04,612 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,612 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:04,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:04,612 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,612 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:04,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:04,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:54:04,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f5cbdc9[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:04,614 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:54:04,614 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,615 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,615 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:54:04,615 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:54:04,615 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:04,615 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,615 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:04,617 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,617 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:54:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:04,617 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:04,617 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:54:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:04,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:04,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:04,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:54:04,619 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:54:04,619 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:04,619 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:04,619 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,619 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:04,622 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,622 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:04,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:04,622 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:04,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:04,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:04,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:04,623 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:04,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,624 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:04,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,626 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,626 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:04,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:04,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:04,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:04,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:04,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:04,627 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:04,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,627 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:04,627 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:04,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:04,627 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:04,727 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:04,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:04,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:04,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:04,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,735 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:04,735 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:04,735 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:54:04,735 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:54:04,736 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,736 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,737 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,737 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:04,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:04,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:04,737 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:04,737 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:04,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:04,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,738 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,739 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:54:04,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:04,739 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:54:04,739 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:04,739 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:54:04,739 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:04,739 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:04,739 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:04,739 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. started... 2023-12-03 10:54:04,739 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6569c89c13b80b87af2e4ef76aca532c 1/1 column families, dataSize=74 B heapSize=408 B 2023-12-03 10:54:05,154 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128856903c31cf04e2992e6d8bc135a0c55 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128856903c31cf04e2992e6d8bc135a0c55 2023-12-03 10:54:05,561 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/0c7ffc641f9f41a099846b0106ad26b6 2023-12-03 10:54:05,566 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/0c7ffc641f9f41a099846b0106ad26b6 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/0c7ffc641f9f41a099846b0106ad26b6 2023-12-03 10:54:05,570 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/0c7ffc641f9f41a099846b0106ad26b6, entries=1, sequenceid=9, filesize=5.0 K 2023-12-03 10:54:05,571 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6569c89c13b80b87af2e4ef76aca532c in 832ms, sequenceid=9, compaction requested=false 2023-12-03 10:54:05,571 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:05,571 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:05,571 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:05,571 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:05,571 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,571 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:54:05,571 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:54:05,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,573 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:05,574 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,574 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:05,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:54:05,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@301f26c0[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:05,576 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:54:05,576 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,578 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:54:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:54:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:05,578 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,578 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:05,580 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:54:05,580 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,580 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:05,580 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:54:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:05,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:54:05,583 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:54:05,583 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:05,583 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:05,583 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,583 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:05,585 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,585 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,585 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:05,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,586 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,587 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,593 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,593 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:05,593 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:05,593 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:05,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-12-03 10:54:05,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:05,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:05,594 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:05,594 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,594 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:05,594 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,594 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:05,594 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,594 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:05,594 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,694 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:05,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:05,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:05,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:05,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,701 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:05,701 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:05,701 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:54:05,701 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:54:05,702 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,702 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,703 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,703 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:05,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:05,703 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:05,703 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:05,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,704 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,704 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:54:05,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:05,705 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:54:05,705 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:05,705 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:54:05,705 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:05,705 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:05,705 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:05,705 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. started... 2023-12-03 10:54:05,705 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6569c89c13b80b87af2e4ef76aca532c 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:05,718 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120182322f6f5d3d40a8801fcb356dcb52ea to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120182322f6f5d3d40a8801fcb356dcb52ea 2023-12-03 10:54:06,124 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/a03182ae302344dd9f3999b347108680 2023-12-03 10:54:06,129 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/a03182ae302344dd9f3999b347108680 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/a03182ae302344dd9f3999b347108680 2023-12-03 10:54:06,133 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/a03182ae302344dd9f3999b347108680, entries=1, sequenceid=13, filesize=4.9 K 2023-12-03 10:54:06,134 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6569c89c13b80b87af2e4ef76aca532c in 429ms, sequenceid=13, compaction requested=true 2023-12-03 10:54:06,134 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:06,134 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:06,134 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:06,134 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:06,134 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,134 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:54:06,134 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:54:06,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,136 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:06,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:06,137 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:06,137 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:06,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:06,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:06,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:54:06,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@421de2de[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:06,138 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:54:06,138 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,140 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,140 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:54:06,140 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:54:06,141 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:06,141 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,141 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:06,143 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:54:06,143 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,143 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:06,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:06,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:06,143 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:54:06,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:06,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:06,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:06,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:06,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:54:06,146 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:54:06,146 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:06,146 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:06,146 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,146 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:06,148 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,148 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:06,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:06,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,148 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:06,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:06,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:06,149 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,150 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:06,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,152 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,152 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,152 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:06,152 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:06,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:06,153 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:06,153 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,153 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:06,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:06,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:06,153 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,153 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,153 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:06,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:06,153 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:06,153 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:06,253 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:06,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:06,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:06,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:06,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,261 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:06,261 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:06,261 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:54:06,261 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:54:06,261 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,262 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,263 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:06,263 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:06,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:06,264 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:06,264 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,265 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:54:06,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:06,265 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:54:06,265 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:06,265 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:54:06,265 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:06,265 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:06,265 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:06,265 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. started... 2023-12-03 10:54:06,265 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6569c89c13b80b87af2e4ef76aca532c 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:06,679 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058a600efdb1ab4a08a348a3a5ecb5bb7f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512058a600efdb1ab4a08a348a3a5ecb5bb7f 2023-12-03 10:54:07,084 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/cb4f4cef3a2c400091f9c41189d7b2d9 2023-12-03 10:54:07,090 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/cb4f4cef3a2c400091f9c41189d7b2d9 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cb4f4cef3a2c400091f9c41189d7b2d9 2023-12-03 10:54:07,094 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cb4f4cef3a2c400091f9c41189d7b2d9, entries=1, sequenceid=17, filesize=4.9 K 2023-12-03 10:54:07,094 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6569c89c13b80b87af2e4ef76aca532c in 829ms, sequenceid=17, compaction requested=true 2023-12-03 10:54:07,095 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:07,095 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:07,095 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:07,095 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:07,095 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,095 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:54:07,095 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:54:07,099 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,099 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:07,099 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,099 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3865a9e7[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:07,100 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:54:07,101 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,102 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,102 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:54:07,102 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:54:07,102 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:07,102 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,102 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:07,104 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:54:07,104 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,104 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:07,104 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:54:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:54:07,106 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:54:07,107 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:07,107 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:07,107 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,107 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:07,108 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,108 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,109 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:07,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:07,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:07,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:07,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:07,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:07,109 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,111 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:07,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,114 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,114 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,114 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:07,114 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:07,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-12-03 10:54:07,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:07,114 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,114 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:07,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:07,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:07,114 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:07,114 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,114 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,114 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:07,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:07,115 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:07,115 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:07,215 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:07,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:07,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:07,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:07,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,222 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:07,222 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:07,222 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:54:07,222 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:54:07,223 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,223 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,224 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,224 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:07,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:07,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:07,225 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:07,225 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:07,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,226 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,226 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:54:07,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:07,226 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:54:07,226 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:07,226 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:54:07,226 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:07,226 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:07,226 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:07,226 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. started... 2023-12-03 10:54:07,226 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6569c89c13b80b87af2e4ef76aca532c 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:07,639 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281f64b7e583174c3d8214d6adf4a904ad to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512281f64b7e583174c3d8214d6adf4a904ad 2023-12-03 10:54:08,045 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/cff796c7898b4756873e8c1e9626df5e 2023-12-03 10:54:08,050 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/cff796c7898b4756873e8c1e9626df5e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cff796c7898b4756873e8c1e9626df5e 2023-12-03 10:54:08,054 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cff796c7898b4756873e8c1e9626df5e, entries=1, sequenceid=21, filesize=4.9 K 2023-12-03 10:54:08,055 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6569c89c13b80b87af2e4ef76aca532c in 829ms, sequenceid=21, compaction requested=true 2023-12-03 10:54:08,055 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:08,055 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:08,055 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:08,055 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:08,056 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,056 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:54:08,056 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:54:08,058 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:08,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:54:08,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@224df9d7[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:08,059 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:54:08,060 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,061 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,061 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:54:08,061 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:54:08,061 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:08,061 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,061 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:08,063 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:54:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:54:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:08,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:54:08,065 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:54:08,066 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:08,066 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:08,066 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,066 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:08,071 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,071 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:08,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,071 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:08,072 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,073 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:08,076 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:08,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:08,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:08,076 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:08,177 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:08,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:08,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:08,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:08,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,184 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:08,184 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:08,184 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:54:08,184 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:54:08,184 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,184 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,187 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:08,187 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:08,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:08,187 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:08,187 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:08,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:08,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,188 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,188 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:54:08,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:08,188 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:54:08,188 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:08,188 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:54:08,188 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:08,188 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:08,188 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:08,189 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. started... 2023-12-03 10:54:08,189 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6569c89c13b80b87af2e4ef76aca532c 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:08,602 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231111498556aa946e0aec0af817ec20432 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231111498556aa946e0aec0af817ec20432 2023-12-03 10:54:09,008 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/1b061fe211a44e6eb14950704502b452 2023-12-03 10:54:09,013 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/1b061fe211a44e6eb14950704502b452 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/1b061fe211a44e6eb14950704502b452 2023-12-03 10:54:09,017 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/1b061fe211a44e6eb14950704502b452, entries=1, sequenceid=25, filesize=4.9 K 2023-12-03 10:54:09,018 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6569c89c13b80b87af2e4ef76aca532c in 829ms, sequenceid=25, compaction requested=true 2023-12-03 10:54:09,018 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:09,018 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:09,018 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:09,018 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:09,018 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,018 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:54:09,018 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:54:09,020 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,020 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:09,020 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,020 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:09,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:54:09,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6badf278[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:09,022 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:54:09,022 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,023 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,023 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:54:09,023 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:54:09,023 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:09,023 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,024 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:09,025 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:54:09,025 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:09,025 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,025 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:54:09,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:09,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:09,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:54:09,028 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:54:09,028 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:09,028 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:09,028 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,028 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:09,034 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,034 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,034 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:09,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:09,035 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:09,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,037 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,039 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,039 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:09,039 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:09,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:09,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:09,039 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:09,039 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,039 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:09,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:09,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,040 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:09,040 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:09,040 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:09,140 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:09,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:09,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:09,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:09,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,146 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:09,146 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:09,146 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:54:09,147 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:54:09,147 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,147 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,149 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:09,149 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:09,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:09,150 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,150 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:09,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:09,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,151 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,151 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:54:09,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,151 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:54:09,151 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:09,151 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:54:09,151 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:09,151 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:09,151 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:09,151 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. started... 2023-12-03 10:54:09,152 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6569c89c13b80b87af2e4ef76aca532c 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:09,565 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101582b26926fb14c48a8ccd6b3061e9549 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101582b26926fb14c48a8ccd6b3061e9549 2023-12-03 10:54:09,970 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/317b287eff5042899bc280e436b4aab8 2023-12-03 10:54:09,975 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/317b287eff5042899bc280e436b4aab8 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/317b287eff5042899bc280e436b4aab8 2023-12-03 10:54:09,980 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/317b287eff5042899bc280e436b4aab8, entries=1, sequenceid=29, filesize=4.9 K 2023-12-03 10:54:09,981 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6569c89c13b80b87af2e4ef76aca532c in 829ms, sequenceid=29, compaction requested=true 2023-12-03 10:54:09,981 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:09,981 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:09,981 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:09,981 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:09,981 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,981 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:54:09,981 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:54:09,983 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,983 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:09,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:09,983 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,983 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:09,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:09,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:09,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:54:09,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@468bf6c1[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:09,985 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:54:09,985 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,986 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,987 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:54:09,987 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:54:09,987 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:09,987 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,987 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:09,988 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,988 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:54:09,988 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:09,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,988 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:54:09,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:09,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:09,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:09,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:09,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:09,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:54:09,991 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:54:09,991 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:09,991 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:09,991 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,991 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:09,992 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,992 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,992 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:09,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:09,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:09,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:09,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:09,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:09,993 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:09,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,995 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:09,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-12-03 10:54:09,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,998 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:09,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:09,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,998 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:09,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:09,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:10,098 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:10,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:10,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:10,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:10,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,105 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:10,105 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:10,105 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:54:10,105 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:54:10,106 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,106 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,109 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,109 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:10,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:10,109 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,109 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,110 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,110 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:54:10,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,110 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:54:10,110 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:10,110 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:54:10,110 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:10,110 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:10,111 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:10,111 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. started... 2023-12-03 10:54:10,111 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6569c89c13b80b87af2e4ef76aca532c 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:10,525 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ccd4bd0bf4d94e58928557c3dae417fc to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ccd4bd0bf4d94e58928557c3dae417fc 2023-12-03 10:54:10,930 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/d12a39f5539b42759314c53c0550ee25 2023-12-03 10:54:10,936 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/d12a39f5539b42759314c53c0550ee25 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/d12a39f5539b42759314c53c0550ee25 2023-12-03 10:54:10,941 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/d12a39f5539b42759314c53c0550ee25, entries=1, sequenceid=33, filesize=4.9 K 2023-12-03 10:54:10,942 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6569c89c13b80b87af2e4ef76aca532c in 831ms, sequenceid=33, compaction requested=true 2023-12-03 10:54:10,942 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:10,942 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:10,942 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:10,942 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:10,942 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,942 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:54:10,942 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:54:10,944 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,944 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:10,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:10,944 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,944 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:10,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:10,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:10,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:10,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:54:10,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53345566[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:10,946 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:54:10,946 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,950 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,950 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:54:10,950 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:54:10,950 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:10,950 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,950 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:10,952 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:54:10,952 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,953 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:10,953 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:54:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:10,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:54:10,955 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:54:10,955 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:10,955 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:10,955 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,955 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:10,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:10,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:10,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:10,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:10,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:10,957 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:10,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:10,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,959 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:10,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,969 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,969 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:10,969 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:10,969 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,969 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:10,969 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:10,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:10,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:10,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:10,969 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:10,969 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,969 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,969 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:10,969 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:10,970 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:10,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:10,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:11,070 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:11,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:11,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:11,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:11,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,077 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:11,077 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:11,077 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:54:11,077 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:54:11,077 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,077 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,079 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,079 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:11,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:11,079 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,079 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:11,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,080 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,080 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:54:11,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,080 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:54:11,080 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:11,080 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:54:11,081 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:11,081 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:11,081 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:11,081 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. started... 2023-12-03 10:54:11,081 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6569c89c13b80b87af2e4ef76aca532c 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:11,496 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090747de6d87451844f7b9a08eb148cdd28d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090747de6d87451844f7b9a08eb148cdd28d 2023-12-03 10:54:11,902 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/be9190299c4c42c5ba6dda992bd7738c 2023-12-03 10:54:11,907 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/be9190299c4c42c5ba6dda992bd7738c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/be9190299c4c42c5ba6dda992bd7738c 2023-12-03 10:54:11,912 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/be9190299c4c42c5ba6dda992bd7738c, entries=1, sequenceid=37, filesize=4.9 K 2023-12-03 10:54:11,913 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6569c89c13b80b87af2e4ef76aca532c in 832ms, sequenceid=37, compaction requested=true 2023-12-03 10:54:11,913 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:11,913 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:11,913 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:11,913 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:11,913 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,913 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:54:11,913 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:54:11,916 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,916 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:11,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:11,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:11,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:11,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:54:11,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1efa9d96[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:11,918 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:54:11,918 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,920 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,920 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:54:11,920 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:54:11,920 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:11,920 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,920 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:11,921 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,921 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:54:11,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:11,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:11,921 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:11,922 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:54:11,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:11,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:11,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:11,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:11,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:54:11,924 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:54:11,924 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:11,924 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:11,924 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,924 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:11,926 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,926 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:11,926 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:11,927 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,928 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,931 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,931 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:11,931 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:11,932 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:11,932 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:11,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:11,932 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:11,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:11,932 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:11,932 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,932 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,932 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:11,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:11,932 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:11,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:11,932 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:12,032 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:12,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:12,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:12,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:12,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,039 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:12,039 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:12,039 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-12-03 10:54:12,039 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-12-03 10:54:12,040 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,040 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,041 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:12,041 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:12,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:12,042 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,042 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:12,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:12,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,042 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,043 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-12-03 10:54:12,043 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,043 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-12-03 10:54:12,043 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:12,043 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-12-03 10:54:12,043 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:12,043 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:12,043 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:12,043 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. started... 2023-12-03 10:54:12,043 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6569c89c13b80b87af2e4ef76aca532c 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:12,457 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112033f4e685c15d4023902e2d79b44842f4 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112033f4e685c15d4023902e2d79b44842f4 2023-12-03 10:54:12,462 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/91221566db8d41a584aa11aafb8fb95c 2023-12-03 10:54:12,466 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/91221566db8d41a584aa11aafb8fb95c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/91221566db8d41a584aa11aafb8fb95c 2023-12-03 10:54:12,469 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/91221566db8d41a584aa11aafb8fb95c, entries=1, sequenceid=41, filesize=4.9 K 2023-12-03 10:54:12,470 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6569c89c13b80b87af2e4ef76aca532c in 427ms, sequenceid=41, compaction requested=true 2023-12-03 10:54:12,470 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:12,470 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:12,470 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:12,470 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:12,470 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,470 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-12-03 10:54:12,470 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-12-03 10:54:12,472 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:12,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:12,473 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:12,473 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:12,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:12,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:12,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-12-03 10:54:12,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a409203[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:12,474 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-12-03 10:54:12,474 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,476 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,476 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-12-03 10:54:12,476 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-12-03 10:54:12,476 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:12,476 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,476 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:12,478 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-12-03 10:54:12,478 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,479 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:12,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:12,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:12,479 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-12-03 10:54:12,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:12,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:12,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:12,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:12,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:54:12,481 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-12-03 10:54:12,481 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:12,481 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:12,481 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,481 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:12,483 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,483 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:12,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:12,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,483 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:12,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:12,483 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:12,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:12,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:12,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,485 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:12,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,492 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,492 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:12,492 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:12,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:12,492 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:12,492 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:12,492 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-12-03 10:54:12,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:12,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:12,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:12,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,493 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:12,493 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:12,593 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:12,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:12,596 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-12-03 10:54:12,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:54:12,599 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:54:12,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:12,600 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601452600 2023-12-03 10:54:12,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:54:12,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-12-03 10:54:12,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:54:12,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x7f633213 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:54:12,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6945b59e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:54:12,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:54:13,448 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c345ff1781484f258f1540552cf81695 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c345ff1781484f258f1540552cf81695 2023-12-03 10:54:13,450 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:54:13,463 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:54:13,464 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:54:13,471 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:54:13,472 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:54:13,480 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b44f02b5d0774386b6aa1be7037d1126 first=Optional[r3] last=Optional[r6] 2023-12-03 10:54:13,481 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b44f02b5d0774386b6aa1be7037d1126}] 2023-12-03 10:54:13,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b44f02b5d0774386b6aa1be7037d1126 for inclusion in 6569c89c13b80b87af2e4ef76aca532c/family1 2023-12-03 10:54:13,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-12-03 10:54:13,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:54:13,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:13,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b44f02b5d0774386b6aa1be7037d1126 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u2qphfq6ceij5hqc8bd43dt5qu7v9ar6kjidnk6op5d6vn2jgk6k0k5mk0catmqg/family1/b44f02b5d0774386b6aa1be7037d1126 2023-12-03 10:54:13,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u2qphfq6ceij5hqc8bd43dt5qu7v9ar6kjidnk6op5d6vn2jgk6k0k5mk0catmqg/family1/b44f02b5d0774386b6aa1be7037d1126 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/7de6819ec870409d963d77642087b235_SeqId_44_ 2023-12-03 10:54:13,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u2qphfq6ceij5hqc8bd43dt5qu7v9ar6kjidnk6op5d6vn2jgk6k0k5mk0catmqg/family1/b44f02b5d0774386b6aa1be7037d1126 into 6569c89c13b80b87af2e4ef76aca532c/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/7de6819ec870409d963d77642087b235_SeqId_44_ - updating store file list. 2023-12-03 10:54:13,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/7de6819ec870409d963d77642087b235_SeqId_44_ into 6569c89c13b80b87af2e4ef76aca532c/family1 2023-12-03 10:54:13,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u2qphfq6ceij5hqc8bd43dt5qu7v9ar6kjidnk6op5d6vn2jgk6k0k5mk0catmqg/family1/b44f02b5d0774386b6aa1be7037d1126 into 6569c89c13b80b87af2e4ef76aca532c/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/7de6819ec870409d963d77642087b235_SeqId_44_) 2023-12-03 10:54:13,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u2qphfq6ceij5hqc8bd43dt5qu7v9ar6kjidnk6op5d6vn2jgk6k0k5mk0catmqg/family1/b44f02b5d0774386b6aa1be7037d1126 2023-12-03 10:54:13,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-12-03 10:54:13,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-12-03 10:54:13,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): 6569c89c13b80b87af2e4ef76aca532c/family1 is initiating minor compaction 2023-12-03 10:54:13,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4f1dba3b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:13,498 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6569c89c13b80b87af2e4ef76aca532c/family1 in testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:13,499 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/0c7ffc641f9f41a099846b0106ad26b6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/a03182ae302344dd9f3999b347108680, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cb4f4cef3a2c400091f9c41189d7b2d9, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cff796c7898b4756873e8c1e9626df5e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/1b061fe211a44e6eb14950704502b452, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/317b287eff5042899bc280e436b4aab8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/d12a39f5539b42759314c53c0550ee25, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/be9190299c4c42c5ba6dda992bd7738c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/91221566db8d41a584aa11aafb8fb95c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/7de6819ec870409d963d77642087b235_SeqId_44_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp, totalSize=50.0 K 2023-12-03 10:54:13,499 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 0c7ffc641f9f41a099846b0106ad26b6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-12-03 10:54:13,499 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting a03182ae302344dd9f3999b347108680, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-12-03 10:54:13,499 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting cb4f4cef3a2c400091f9c41189d7b2d9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-12-03 10:54:13,499 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting cff796c7898b4756873e8c1e9626df5e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-12-03 10:54:13,499 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 1b061fe211a44e6eb14950704502b452, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-12-03 10:54:13,499 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 317b287eff5042899bc280e436b4aab8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-12-03 10:54:13,499 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting d12a39f5539b42759314c53c0550ee25, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-12-03 10:54:13,499 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting be9190299c4c42c5ba6dda992bd7738c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-12-03 10:54:13,499 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 91221566db8d41a584aa11aafb8fb95c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-12-03 10:54:13,499 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 7de6819ec870409d963d77642087b235_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-12-03 10:54:13,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:54:13,501 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:13,503 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512281f64b7e583174c3d8214d6adf4a904ad to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512281f64b7e583174c3d8214d6adf4a904ad 2023-12-03 10:54:13,504 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231111498556aa946e0aec0af817ec20432 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231111498556aa946e0aec0af817ec20432 2023-12-03 10:54:13,506 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101582b26926fb14c48a8ccd6b3061e9549 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101582b26926fb14c48a8ccd6b3061e9549 2023-12-03 10:54:13,507 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ccd4bd0bf4d94e58928557c3dae417fc to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ccd4bd0bf4d94e58928557c3dae417fc 2023-12-03 10:54:13,507 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-12-03 10:54:13,507 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-12-03 10:54:13,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:54:13,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:54:13,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:54:13,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:54:13,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:54:13,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:54:13,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:54:13,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:54:13,536 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6569c89c13b80b87af2e4ef76aca532c#family1#compaction#49 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:54:14,356 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/929d08847cba4ed7acc0d9cc9374a7ed as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/929d08847cba4ed7acc0d9cc9374a7ed 2023-12-03 10:54:14,362 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6569c89c13b80b87af2e4ef76aca532c/family1 of 6569c89c13b80b87af2e4ef76aca532c into 929d08847cba4ed7acc0d9cc9374a7ed(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:54:14,362 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:14,362 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1701600853498; duration=0sec 2023-12-03 10:54:14,363 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:14,380 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b17d6b7498ee4d7d9229811b8f916497 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b17d6b7498ee4d7d9229811b8f916497 2023-12-03 10:54:14,381 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:54:14,408 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f35acce6d6c845fbaa7342f2b0d003b5 first=Optional[r00] last=Optional[r2] 2023-12-03 10:54:14,409 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f35acce6d6c845fbaa7342f2b0d003b5}] 2023-12-03 10:54:14,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f35acce6d6c845fbaa7342f2b0d003b5 for inclusion in 6569c89c13b80b87af2e4ef76aca532c/family1 2023-12-03 10:54:14,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-12-03 10:54:14,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:54:14,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:14,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f35acce6d6c845fbaa7342f2b0d003b5 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyPolicy__euob9ru869mt0s5k2pt57b3q115o0e0apjoipi44rt01129td1mh2cjnnlk39ner/family1/f35acce6d6c845fbaa7342f2b0d003b5 2023-12-03 10:54:14,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyPolicy__euob9ru869mt0s5k2pt57b3q115o0e0apjoipi44rt01129td1mh2cjnnlk39ner/family1/f35acce6d6c845fbaa7342f2b0d003b5 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/9c8b5f4cf3a94493967b518e389dd952_SeqId_47_ 2023-12-03 10:54:14,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyPolicy__euob9ru869mt0s5k2pt57b3q115o0e0apjoipi44rt01129td1mh2cjnnlk39ner/family1/f35acce6d6c845fbaa7342f2b0d003b5 into 6569c89c13b80b87af2e4ef76aca532c/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/9c8b5f4cf3a94493967b518e389dd952_SeqId_47_ - updating store file list. 2023-12-03 10:54:14,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/9c8b5f4cf3a94493967b518e389dd952_SeqId_47_ into 6569c89c13b80b87af2e4ef76aca532c/family1 2023-12-03 10:54:14,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyPolicy__euob9ru869mt0s5k2pt57b3q115o0e0apjoipi44rt01129td1mh2cjnnlk39ner/family1/f35acce6d6c845fbaa7342f2b0d003b5 into 6569c89c13b80b87af2e4ef76aca532c/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/9c8b5f4cf3a94493967b518e389dd952_SeqId_47_) 2023-12-03 10:54:14,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyPolicy__euob9ru869mt0s5k2pt57b3q115o0e0apjoipi44rt01129td1mh2cjnnlk39ner/family1/f35acce6d6c845fbaa7342f2b0d003b5 2023-12-03 10:54:14,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-12-03 10:54:14,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-12-03 10:54:14,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): 6569c89c13b80b87af2e4ef76aca532c/family1 is initiating minor compaction (all files) 2023-12-03 10:54:14,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@67ece6d8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:14,427 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6569c89c13b80b87af2e4ef76aca532c/family1 in testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:54:14,427 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/f0617eaa06f343b78f7107ba68b3f980, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/929d08847cba4ed7acc0d9cc9374a7ed, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/9c8b5f4cf3a94493967b518e389dd952_SeqId_47_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp, totalSize=337.0 K 2023-12-03 10:54:14,428 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting f0617eaa06f343b78f7107ba68b3f980, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823227 2023-12-03 10:54:14,428 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 929d08847cba4ed7acc0d9cc9374a7ed, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223227 2023-12-03 10:54:14,429 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 9c8b5f4cf3a94493967b518e389dd952_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823227 2023-12-03 10:54:14,430 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:54:14,430 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:14,433 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511305410fea2041d42ab98f94d432ccdf792 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511305410fea2041d42ab98f94d432ccdf792 2023-12-03 10:54:14,434 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120182322f6f5d3d40a8801fcb356dcb52ea to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120182322f6f5d3d40a8801fcb356dcb52ea 2023-12-03 10:54:14,435 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512058a600efdb1ab4a08a348a3a5ecb5bb7f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512058a600efdb1ab4a08a348a3a5ecb5bb7f 2023-12-03 10:54:14,435 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-12-03 10:54:14,435 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-12-03 10:54:14,436 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-12-03 10:54:14,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-12-03 10:54:14,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:14,437 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:54:14,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8400 sec 2023-12-03 10:54:14,452 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6569c89c13b80b87af2e4ef76aca532c#family1#compaction#50 average throughput is 11.90 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:54:14,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/0c7ffc641f9f41a099846b0106ad26b6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/a03182ae302344dd9f3999b347108680, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cb4f4cef3a2c400091f9c41189d7b2d9, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cff796c7898b4756873e8c1e9626df5e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/1b061fe211a44e6eb14950704502b452, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/317b287eff5042899bc280e436b4aab8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/d12a39f5539b42759314c53c0550ee25, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/be9190299c4c42c5ba6dda992bd7738c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/91221566db8d41a584aa11aafb8fb95c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/7de6819ec870409d963d77642087b235_SeqId_44_] to archive 2023-12-03 10:54:14,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:14,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/0c7ffc641f9f41a099846b0106ad26b6 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/0c7ffc641f9f41a099846b0106ad26b6 2023-12-03 10:54:14,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/a03182ae302344dd9f3999b347108680 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/a03182ae302344dd9f3999b347108680 2023-12-03 10:54:14,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cb4f4cef3a2c400091f9c41189d7b2d9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cb4f4cef3a2c400091f9c41189d7b2d9 2023-12-03 10:54:14,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cff796c7898b4756873e8c1e9626df5e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/cff796c7898b4756873e8c1e9626df5e 2023-12-03 10:54:14,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/1b061fe211a44e6eb14950704502b452 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/1b061fe211a44e6eb14950704502b452 2023-12-03 10:54:14,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/317b287eff5042899bc280e436b4aab8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/317b287eff5042899bc280e436b4aab8 2023-12-03 10:54:14,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/d12a39f5539b42759314c53c0550ee25 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/d12a39f5539b42759314c53c0550ee25 2023-12-03 10:54:14,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/be9190299c4c42c5ba6dda992bd7738c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/be9190299c4c42c5ba6dda992bd7738c 2023-12-03 10:54:14,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/91221566db8d41a584aa11aafb8fb95c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/91221566db8d41a584aa11aafb8fb95c 2023-12-03 10:54:14,477 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/7de6819ec870409d963d77642087b235_SeqId_44_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/7de6819ec870409d963d77642087b235_SeqId_44_ 2023-12-03 10:54:14,558 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=264 (was 249) - Thread LEAK? -, OpenFileDescriptor=648 (was 612) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 243), ProcessCount=173 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=3256 (was 3263) 2023-12-03 10:54:14,570 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=264, OpenFileDescriptor=648, MaxFileDescriptor=60000, SystemLoadAverage=211, ProcessCount=173, AvailableMemoryMB=3256 2023-12-03 10:54:14,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-12-03 10:54:14,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:14,575 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:54:14,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-12-03 10:54:14,575 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:54:14,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-12-03 10:54:14,577 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:14,577 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8 empty. 2023-12-03 10:54:14,578 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:14,578 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-12-03 10:54:14,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-12-03 10:54:14,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-12-03 10:54:14,986 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-12-03 10:54:14,987 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 301f476df2adc9532f12cced548b13e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:54:15,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-12-03 10:54:15,393 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:15,393 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 301f476df2adc9532f12cced548b13e8, disabling compactions & flushes 2023-12-03 10:54:15,393 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:15,393 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:15,393 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. after waiting 0 ms 2023-12-03 10:54:15,393 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:15,393 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:15,393 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:15,396 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:54:15,397 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600855397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600855397"}]},"ts":"1701600855397"} 2023-12-03 10:54:15,398 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-03 10:54:15,399 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:54:15,399 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600855399"}]},"ts":"1701600855399"} 2023-12-03 10:54:15,400 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-12-03 10:54:15,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, ASSIGN}] 2023-12-03 10:54:15,404 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, ASSIGN 2023-12-03 10:54:15,405 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:54:15,556 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=301f476df2adc9532f12cced548b13e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:15,556 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600855556"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600855556"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600855556"}]},"ts":"1701600855556"} 2023-12-03 10:54:15,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 301f476df2adc9532f12cced548b13e8, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:15,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-12-03 10:54:15,688 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/.tmp/family1/98616947b3264931830a432db4fccdf5 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/98616947b3264931830a432db4fccdf5 2023-12-03 10:54:15,694 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6569c89c13b80b87af2e4ef76aca532c/family1 of 6569c89c13b80b87af2e4ef76aca532c into 98616947b3264931830a432db4fccdf5(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:54:15,694 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:54:15,694 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1701600854427; duration=1sec 2023-12-03 10:54:15,694 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:15,710 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:15,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:15,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 301f476df2adc9532f12cced548b13e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:54:15,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:15,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:15,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:15,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:15,714 INFO [StoreOpener-301f476df2adc9532f12cced548b13e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:15,716 DEBUG [StoreOpener-301f476df2adc9532f12cced548b13e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:15,716 DEBUG [StoreOpener-301f476df2adc9532f12cced548b13e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:15,716 INFO [StoreOpener-301f476df2adc9532f12cced548b13e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 301f476df2adc9532f12cced548b13e8 columnFamilyName family1 2023-12-03 10:54:15,717 INFO [StoreOpener-301f476df2adc9532f12cced548b13e8-1] regionserver.HStore(310): Store=301f476df2adc9532f12cced548b13e8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:15,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:15,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:15,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:15,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:54:15,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 301f476df2adc9532f12cced548b13e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61155926, jitterRate=-0.08870568871498108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:54:15,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:15,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8., pid=41, masterSystemTime=1701600855710 2023-12-03 10:54:15,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:15,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:15,726 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=301f476df2adc9532f12cced548b13e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:15,726 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600855726"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600855726"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600855726"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600855726"}]},"ts":"1701600855726"} 2023-12-03 10:54:15,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=40 2023-12-03 10:54:15,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 301f476df2adc9532f12cced548b13e8, server=jenkins-hbase4.apache.org,44259,1701600798821 in 170 msec 2023-12-03 10:54:15,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2023-12-03 10:54:15,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, ASSIGN in 325 msec 2023-12-03 10:54:15,731 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:54:15,732 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600855731"}]},"ts":"1701600855731"} 2023-12-03 10:54:15,733 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-12-03 10:54:15,735 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:54:15,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1630 sec 2023-12-03 10:54:15,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/f0617eaa06f343b78f7107ba68b3f980, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/929d08847cba4ed7acc0d9cc9374a7ed, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/9c8b5f4cf3a94493967b518e389dd952_SeqId_47_] to archive 2023-12-03 10:54:15,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:15,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/f0617eaa06f343b78f7107ba68b3f980 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/f0617eaa06f343b78f7107ba68b3f980 2023-12-03 10:54:15,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/929d08847cba4ed7acc0d9cc9374a7ed to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/929d08847cba4ed7acc0d9cc9374a7ed 2023-12-03 10:54:15,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/9c8b5f4cf3a94493967b518e389dd952_SeqId_47_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/family1/9c8b5f4cf3a94493967b518e389dd952_SeqId_47_ 2023-12-03 10:54:16,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-12-03 10:54:16,681 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-12-03 10:54:16,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:16,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:16,707 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:16,707 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:16,707 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-12-03 10:54:16,707 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-12-03 10:54:16,707 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:16,707 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:16,715 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:16,715 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:16,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:16,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:16,715 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:16,715 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:16,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:16,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:16,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:16,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:16,716 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:16,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:16,716 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-12-03 10:54:16,716 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:16,716 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-12-03 10:54:16,716 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:16,717 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:16,717 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:16,717 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. started... 2023-12-03 10:54:16,717 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 301f476df2adc9532f12cced548b13e8 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-12-03 10:54:17,141 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130704440fc7355454ea63b49e3912de328 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130704440fc7355454ea63b49e3912de328 2023-12-03 10:54:17,545 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/adae1bddfee14c0da20e3c0fced7f599 2023-12-03 10:54:17,550 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/adae1bddfee14c0da20e3c0fced7f599 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/adae1bddfee14c0da20e3c0fced7f599 2023-12-03 10:54:17,554 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/adae1bddfee14c0da20e3c0fced7f599, entries=1000, sequenceid=5, filesize=191.4 K 2023-12-03 10:54:17,555 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 301f476df2adc9532f12cced548b13e8 in 838ms, sequenceid=5, compaction requested=false 2023-12-03 10:54:17,555 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:17,556 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:17,556 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:17,556 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:17,556 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:17,556 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,556 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-12-03 10:54:17,556 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-12-03 10:54:17,558 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,558 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:17,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:17,558 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,558 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:17,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:17,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:17,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:17,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-12-03 10:54:17,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e44274[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:17,560 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-12-03 10:54:17,560 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,561 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,561 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-12-03 10:54:17,561 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-12-03 10:54:17,561 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:17,562 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,562 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:17,563 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-12-03 10:54:17,563 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,563 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:17,563 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-12-03 10:54:17,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:17,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:17,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:17,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:17,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:17,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:17,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-12-03 10:54:17,566 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-12-03 10:54:17,566 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:17,566 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:17,566 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,566 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:17,568 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,568 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,568 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:17,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:17,569 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,570 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:17,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:17,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:17,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:17,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,573 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:17,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:17,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,573 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:17,574 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:17,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:17,674 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:17,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:17,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:17,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:17,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,680 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:17,681 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:17,681 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-12-03 10:54:17,681 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-12-03 10:54:17,681 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,681 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,682 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:17,682 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:17,683 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:17,683 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,684 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,684 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-12-03 10:54:17,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:17,684 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-12-03 10:54:17,684 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:17,684 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-12-03 10:54:17,684 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:17,684 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:17,684 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:17,684 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. started... 2023-12-03 10:54:17,684 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 301f476df2adc9532f12cced548b13e8 1/1 column families, dataSize=74 B heapSize=408 B 2023-12-03 10:54:18,098 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c152af345c9f4b8994423d954ff08c2d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128c152af345c9f4b8994423d954ff08c2d 2023-12-03 10:54:18,105 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/b2f76dbcfc124facaa6cefce86a10416 2023-12-03 10:54:18,110 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/b2f76dbcfc124facaa6cefce86a10416 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/b2f76dbcfc124facaa6cefce86a10416 2023-12-03 10:54:18,114 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/b2f76dbcfc124facaa6cefce86a10416, entries=1, sequenceid=9, filesize=5.0 K 2023-12-03 10:54:18,115 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 301f476df2adc9532f12cced548b13e8 in 431ms, sequenceid=9, compaction requested=false 2023-12-03 10:54:18,116 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:18,116 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:18,116 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:18,116 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:18,116 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,116 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-12-03 10:54:18,116 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-12-03 10:54:18,118 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,118 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:18,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:18,119 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,119 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:18,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-12-03 10:54:18,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@728ab80b[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:18,120 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-12-03 10:54:18,120 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,122 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,123 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-12-03 10:54:18,123 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-12-03 10:54:18,123 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:18,123 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,123 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:18,124 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,124 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-12-03 10:54:18,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:18,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:18,124 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:18,124 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-12-03 10:54:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:18,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-12-03 10:54:18,127 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-12-03 10:54:18,127 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:18,127 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:18,127 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,127 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:18,128 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,128 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:18,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,129 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:18,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:18,129 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,130 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:18,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:18,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:18,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:18,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:18,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,136 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:18,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:18,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:18,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,136 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:18,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:18,136 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:18,137 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:18,237 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:18,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:18,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:18,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:18,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,244 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:18,244 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:18,244 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-12-03 10:54:18,244 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-12-03 10:54:18,244 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,244 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,246 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:18,246 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:18,246 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:18,246 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,247 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,247 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-12-03 10:54:18,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:18,247 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-12-03 10:54:18,247 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:18,247 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-12-03 10:54:18,248 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:18,248 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:18,248 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:18,248 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. started... 2023-12-03 10:54:18,248 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 301f476df2adc9532f12cced548b13e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:18,662 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012a296029a7904f16accca8f89e698fff to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512012a296029a7904f16accca8f89e698fff 2023-12-03 10:54:19,068 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/ac82881d03e64819ad1747f48701cb78 2023-12-03 10:54:19,073 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/ac82881d03e64819ad1747f48701cb78 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/ac82881d03e64819ad1747f48701cb78 2023-12-03 10:54:19,078 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/ac82881d03e64819ad1747f48701cb78, entries=1, sequenceid=13, filesize=5.0 K 2023-12-03 10:54:19,079 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 301f476df2adc9532f12cced548b13e8 in 831ms, sequenceid=13, compaction requested=true 2023-12-03 10:54:19,079 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:19,079 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:19,079 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:19,079 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:19,079 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,079 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-12-03 10:54:19,079 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-12-03 10:54:19,081 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,081 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:19,082 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,082 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:19,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-12-03 10:54:19,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38569de1[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:19,083 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-12-03 10:54:19,084 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,085 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,085 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-12-03 10:54:19,085 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-12-03 10:54:19,085 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:19,085 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,085 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:19,087 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,087 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-12-03 10:54:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:19,087 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:19,087 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-12-03 10:54:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:19,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-12-03 10:54:19,090 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-12-03 10:54:19,090 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:19,090 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:19,090 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,090 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:19,094 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,094 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:19,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:19,094 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:19,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:19,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:19,095 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,096 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,099 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,099 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:19,099 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,099 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:19,099 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,099 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:19,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-12-03 10:54:19,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:19,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:19,099 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:19,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:19,099 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,099 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,099 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,100 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:19,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:19,100 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:19,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:19,200 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:19,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:19,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:19,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:19,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,207 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:19,207 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:19,207 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-12-03 10:54:19,207 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-12-03 10:54:19,207 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,207 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,209 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:19,209 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:19,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:19,209 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:19,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,209 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:19,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:19,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,210 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-12-03 10:54:19,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:19,210 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-12-03 10:54:19,210 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:19,210 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-12-03 10:54:19,210 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:19,210 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:19,210 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:19,210 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. started... 2023-12-03 10:54:19,210 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 301f476df2adc9532f12cced548b13e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:19,626 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057eec24669bb744a6886c143e46e4f5bb to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512057eec24669bb744a6886c143e46e4f5bb 2023-12-03 10:54:20,032 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/8b73e5279ec84819a9375ab130a0eefd 2023-12-03 10:54:20,037 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/8b73e5279ec84819a9375ab130a0eefd as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/8b73e5279ec84819a9375ab130a0eefd 2023-12-03 10:54:20,041 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/8b73e5279ec84819a9375ab130a0eefd, entries=1, sequenceid=17, filesize=5.0 K 2023-12-03 10:54:20,042 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 301f476df2adc9532f12cced548b13e8 in 832ms, sequenceid=17, compaction requested=true 2023-12-03 10:54:20,042 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:20,042 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:20,042 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:20,042 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:20,042 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,042 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-12-03 10:54:20,042 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-12-03 10:54:20,045 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,045 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:20,046 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,046 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:20,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-12-03 10:54:20,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2618c062[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:20,047 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-12-03 10:54:20,047 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,048 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,049 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-12-03 10:54:20,049 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-12-03 10:54:20,049 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:20,049 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,049 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:20,052 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:20,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:20,052 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-12-03 10:54:20,052 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:20,053 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-12-03 10:54:20,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:20,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:20,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:20,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:20,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-12-03 10:54:20,055 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-12-03 10:54:20,055 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:20,055 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:20,055 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,055 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:20,057 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,057 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:20,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,057 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:20,058 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,059 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,062 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,062 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,062 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:20,062 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:20,062 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:20,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:20,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:20,062 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,062 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:20,063 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,063 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,063 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:20,063 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:20,063 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:20,163 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:20,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:20,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:20,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:20,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,170 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:20,170 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:20,170 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-12-03 10:54:20,170 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-12-03 10:54:20,170 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,170 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,172 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,172 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:20,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:20,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:20,172 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:20,172 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:20,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:20,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,174 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,174 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-12-03 10:54:20,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:20,174 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-12-03 10:54:20,174 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:20,174 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-12-03 10:54:20,174 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:20,174 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:20,174 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:20,174 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. started... 2023-12-03 10:54:20,174 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 301f476df2adc9532f12cced548b13e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:20,263 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-12-03 10:54:20,590 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286525d93f6f9b4666a7be686712d41324 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512286525d93f6f9b4666a7be686712d41324 2023-12-03 10:54:20,995 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/665244bd17cf4cf59505c99ab29e7d0b 2023-12-03 10:54:21,000 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/665244bd17cf4cf59505c99ab29e7d0b as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/665244bd17cf4cf59505c99ab29e7d0b 2023-12-03 10:54:21,004 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/665244bd17cf4cf59505c99ab29e7d0b, entries=1, sequenceid=21, filesize=5.0 K 2023-12-03 10:54:21,005 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 301f476df2adc9532f12cced548b13e8 in 831ms, sequenceid=21, compaction requested=true 2023-12-03 10:54:21,005 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:21,005 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:21,005 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:21,005 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:21,005 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,005 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-12-03 10:54:21,005 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-12-03 10:54:21,010 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,010 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:21,010 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,010 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:21,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-12-03 10:54:21,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cec137[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:21,012 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-12-03 10:54:21,012 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,014 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-12-03 10:54:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-12-03 10:54:21,014 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:21,014 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,014 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:21,015 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,015 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-12-03 10:54:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:21,016 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:21,016 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-12-03 10:54:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:21,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-12-03 10:54:21,018 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-12-03 10:54:21,018 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:21,018 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:21,018 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,018 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:21,022 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,022 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,022 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:21,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:21,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:21,023 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,025 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:21,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-12-03 10:54:21,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,028 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:21,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:21,028 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:21,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:21,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:21,128 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:21,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:21,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:21,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:21,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,135 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:21,135 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:21,135 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-12-03 10:54:21,135 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-12-03 10:54:21,135 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,135 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,137 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,137 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:21,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:21,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:21,137 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,137 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:21,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:21,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,138 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,138 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-12-03 10:54:21,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,139 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-12-03 10:54:21,139 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:21,139 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-12-03 10:54:21,139 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:21,139 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:21,139 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:21,139 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. started... 2023-12-03 10:54:21,139 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 301f476df2adc9532f12cced548b13e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:21,241 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:54:21,552 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312533b857959d4468b781e8fb04aeddef to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512312533b857959d4468b781e8fb04aeddef 2023-12-03 10:54:21,960 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/89e22ddf3b6d4e08b1e853f1875398b4 2023-12-03 10:54:21,965 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/89e22ddf3b6d4e08b1e853f1875398b4 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/89e22ddf3b6d4e08b1e853f1875398b4 2023-12-03 10:54:21,969 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/89e22ddf3b6d4e08b1e853f1875398b4, entries=1, sequenceid=25, filesize=5.0 K 2023-12-03 10:54:21,970 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 301f476df2adc9532f12cced548b13e8 in 831ms, sequenceid=25, compaction requested=true 2023-12-03 10:54:21,970 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:21,970 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-12-03 10:54:21,970 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-12-03 10:54:21,973 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,973 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:21,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:21,973 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,973 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:21,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:21,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:21,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:21,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-12-03 10:54:21,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20237b25[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:21,975 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-12-03 10:54:21,975 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,976 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,976 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-12-03 10:54:21,976 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-12-03 10:54:21,976 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:21,977 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,977 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:21,978 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,978 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-12-03 10:54:21,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:21,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:21,978 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:21,979 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-12-03 10:54:21,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:21,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:21,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:21,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:21,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-12-03 10:54:21,981 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-12-03 10:54:21,981 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:21,981 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:21,981 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,981 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:21,983 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,983 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:21,983 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,983 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:21,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:21,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,985 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,987 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,987 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,987 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,987 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:21,987 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:21,988 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:21,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:21,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:21,988 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:21,988 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,988 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:21,988 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:21,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:21,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-12-03 10:54:21,988 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:21,988 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:21,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:21,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:22,088 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:22,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:22,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:22,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:22,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,095 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:22,095 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:22,095 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-12-03 10:54:22,095 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-12-03 10:54:22,095 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,095 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,097 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,097 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:22,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:22,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:22,097 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,097 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:22,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,098 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,098 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-12-03 10:54:22,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,098 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-12-03 10:54:22,098 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:22,098 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-12-03 10:54:22,098 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:22,098 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:22,098 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:22,098 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. started... 2023-12-03 10:54:22,099 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 301f476df2adc9532f12cced548b13e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:22,511 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101abd74dbb72f2457989773046e06631f9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101abd74dbb72f2457989773046e06631f9 2023-12-03 10:54:22,516 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/04901acbd71e479193cfe556f29e3b19 2023-12-03 10:54:22,520 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/04901acbd71e479193cfe556f29e3b19 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/04901acbd71e479193cfe556f29e3b19 2023-12-03 10:54:22,524 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/04901acbd71e479193cfe556f29e3b19, entries=1, sequenceid=29, filesize=5.0 K 2023-12-03 10:54:22,525 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 301f476df2adc9532f12cced548b13e8 in 426ms, sequenceid=29, compaction requested=true 2023-12-03 10:54:22,525 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:22,525 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:22,525 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:22,525 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:22,525 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,525 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-12-03 10:54:22,525 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-12-03 10:54:22,527 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,527 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:22,527 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:22,527 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:22,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:22,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:22,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-12-03 10:54:22,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c165355[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:22,529 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-12-03 10:54:22,529 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,530 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,530 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-12-03 10:54:22,530 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-12-03 10:54:22,530 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:22,530 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,530 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:22,535 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-12-03 10:54:22,535 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:22,535 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,535 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-12-03 10:54:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:22,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-12-03 10:54:22,538 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-12-03 10:54:22,538 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:22,538 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:22,538 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,538 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:22,540 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,540 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:22,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:22,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,540 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:22,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:22,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:22,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:22,541 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:22,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,542 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:22,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:22,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:22,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:22,545 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:22,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:22,545 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:22,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:22,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:22,645 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:22,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:22,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:22,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:22,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,652 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:22,652 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:22,652 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-12-03 10:54:22,652 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-12-03 10:54:22,653 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,653 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,655 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:22,655 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:22,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:22,656 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:22,656 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:22,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:22,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,657 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,657 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-12-03 10:54:22,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:22,657 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-12-03 10:54:22,657 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:22,657 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-12-03 10:54:22,657 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:22,657 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:22,657 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:22,657 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. started... 2023-12-03 10:54:22,658 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 301f476df2adc9532f12cced548b13e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:23,076 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010313937bc239ad4c27a0c30ec703fdd93b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010313937bc239ad4c27a0c30ec703fdd93b 2023-12-03 10:54:23,482 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/38c0586f7a384e3589cedd8f8ed34d9a 2023-12-03 10:54:23,487 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/38c0586f7a384e3589cedd8f8ed34d9a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38c0586f7a384e3589cedd8f8ed34d9a 2023-12-03 10:54:23,491 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38c0586f7a384e3589cedd8f8ed34d9a, entries=1, sequenceid=33, filesize=5.0 K 2023-12-03 10:54:23,492 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 301f476df2adc9532f12cced548b13e8 in 834ms, sequenceid=33, compaction requested=true 2023-12-03 10:54:23,492 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:23,492 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:23,492 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:23,492 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:23,492 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,492 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-12-03 10:54:23,492 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-12-03 10:54:23,494 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,494 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:23,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:23,494 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,494 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:23,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:23,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-12-03 10:54:23,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c6d8d65[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:23,496 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-12-03 10:54:23,496 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,497 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,498 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-12-03 10:54:23,498 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-12-03 10:54:23,498 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:23,498 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,498 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:23,499 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,499 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-12-03 10:54:23,499 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:23,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,499 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-12-03 10:54:23,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:23,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:23,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:23,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-12-03 10:54:23,502 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-12-03 10:54:23,502 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:23,502 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:23,502 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,502 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:23,505 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,505 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:23,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,505 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:23,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:23,505 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,507 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:23,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,509 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,509 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:23,509 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,509 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:23,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:23,509 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:23,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-12-03 10:54:23,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:23,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:23,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:23,509 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,510 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,510 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,510 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,510 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,510 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:23,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:23,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:23,510 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:23,610 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:23,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:23,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:23,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:23,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,617 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:23,617 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:23,617 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-12-03 10:54:23,617 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-12-03 10:54:23,617 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,617 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,619 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:23,619 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:23,619 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:23,619 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:23,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,620 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,620 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-12-03 10:54:23,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:23,620 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-12-03 10:54:23,621 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:23,621 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-12-03 10:54:23,622 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:23,622 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:23,622 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:23,622 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. started... 2023-12-03 10:54:23,622 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 301f476df2adc9532f12cced548b13e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:24,037 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090722754192e47b46c39d85747d0940ea8d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015090722754192e47b46c39d85747d0940ea8d 2023-12-03 10:54:24,443 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/df69d99fca7b4cbfa5bc9218d049cbd0 2023-12-03 10:54:24,449 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/df69d99fca7b4cbfa5bc9218d049cbd0 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/df69d99fca7b4cbfa5bc9218d049cbd0 2023-12-03 10:54:24,453 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/df69d99fca7b4cbfa5bc9218d049cbd0, entries=1, sequenceid=37, filesize=5.0 K 2023-12-03 10:54:24,454 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 301f476df2adc9532f12cced548b13e8 in 832ms, sequenceid=37, compaction requested=true 2023-12-03 10:54:24,454 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:24,454 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-12-03 10:54:24,454 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-12-03 10:54:24,456 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,456 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:24,457 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,457 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:24,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:24,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:24,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:24,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-12-03 10:54:24,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d5b2aa6[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:24,458 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-12-03 10:54:24,458 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,460 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,460 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-12-03 10:54:24,460 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-12-03 10:54:24,460 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:24,460 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,460 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:24,462 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-12-03 10:54:24,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:24,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:24,462 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-12-03 10:54:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:24,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:24,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-12-03 10:54:24,465 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-12-03 10:54:24,465 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:24,465 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:24,465 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,465 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:24,466 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,466 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:24,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,466 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:24,467 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:24,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,468 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:24,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,473 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,473 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:24,474 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:24,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:24,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:24,474 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:24,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-12-03 10:54:24,474 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:24,474 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:24,474 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,474 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,474 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,474 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:24,474 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:24,474 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,574 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:24,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:24,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:24,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:24,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,581 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:24,581 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:24,581 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-12-03 10:54:24,581 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-12-03 10:54:24,582 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,582 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,583 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:24,583 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:24,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:24,584 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:24,584 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:24,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:24,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,585 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,585 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-12-03 10:54:24,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-12-03 10:54:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-12-03 10:54:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:24,586 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:24,586 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:24,586 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. started... 2023-12-03 10:54:24,586 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 301f476df2adc9532f12cced548b13e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:24,998 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120224f6432751a4c1d82245fce4db1e443 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120224f6432751a4c1d82245fce4db1e443 2023-12-03 10:54:25,404 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/38809f76cf3d434ebfe9b8206016c873 2023-12-03 10:54:25,409 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/38809f76cf3d434ebfe9b8206016c873 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38809f76cf3d434ebfe9b8206016c873 2023-12-03 10:54:25,414 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38809f76cf3d434ebfe9b8206016c873, entries=1, sequenceid=41, filesize=5.0 K 2023-12-03 10:54:25,414 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 301f476df2adc9532f12cced548b13e8 in 828ms, sequenceid=41, compaction requested=true 2023-12-03 10:54:25,415 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:25,415 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:25,415 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:25,415 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:25,415 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,415 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-12-03 10:54:25,415 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-12-03 10:54:25,416 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,416 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:25,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,417 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:25,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:25,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:25,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:25,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-12-03 10:54:25,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69a847b[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:25,419 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-12-03 10:54:25,419 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,421 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,421 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-12-03 10:54:25,421 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-12-03 10:54:25,421 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,421 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:25,421 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:25,423 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-12-03 10:54:25,423 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:25,423 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,423 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-12-03 10:54:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:25,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:25,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:25,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-12-03 10:54:25,426 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-12-03 10:54:25,426 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:25,426 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:25,426 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,426 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:25,427 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,427 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:25,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,428 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:25,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:25,428 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,429 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:25,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,432 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,432 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:25,432 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:25,432 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:25,432 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-12-03 10:54:25,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:25,433 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:25,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:25,433 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:25,433 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,433 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,433 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,433 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:25,433 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:25,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:25,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:25,533 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:25,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:25,536 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:25,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-12-03 10:54:25,539 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-12-03 10:54:25,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:25,540 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601465540 2023-12-03 10:54:25,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:54:25,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-12-03 10:54:25,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:25,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x48ad45a6 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:54:25,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c80f068, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:54:25,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:26,007 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103981996c3bdeb4c598cec43814d41e054 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103981996c3bdeb4c598cec43814d41e054 2023-12-03 10:54:26,009 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:26,028 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:54:26,030 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:54:26,036 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:54:26,038 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:54:26,047 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d304f907066d4966b9eb612f2538d3df first=Optional[r3] last=Optional[r6] 2023-12-03 10:54:26,048 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d304f907066d4966b9eb612f2538d3df}] 2023-12-03 10:54:26,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d304f907066d4966b9eb612f2538d3df for inclusion in 301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:26,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-12-03 10:54:26,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:54:26,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:26,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d304f907066d4966b9eb612f2538d3df to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mb8rubmbekn42u8cgc56i9gi5spc41hclhinl12vu6g3tehns4nfmikpelpq0uhp/family1/d304f907066d4966b9eb612f2538d3df 2023-12-03 10:54:26,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mb8rubmbekn42u8cgc56i9gi5spc41hclhinl12vu6g3tehns4nfmikpelpq0uhp/family1/d304f907066d4966b9eb612f2538d3df as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/f40f452afc17415fb752b5c0e2a6e917_SeqId_44_ 2023-12-03 10:54:26,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mb8rubmbekn42u8cgc56i9gi5spc41hclhinl12vu6g3tehns4nfmikpelpq0uhp/family1/d304f907066d4966b9eb612f2538d3df into 301f476df2adc9532f12cced548b13e8/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/f40f452afc17415fb752b5c0e2a6e917_SeqId_44_ - updating store file list. 2023-12-03 10:54:26,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/f40f452afc17415fb752b5c0e2a6e917_SeqId_44_ into 301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:26,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mb8rubmbekn42u8cgc56i9gi5spc41hclhinl12vu6g3tehns4nfmikpelpq0uhp/family1/d304f907066d4966b9eb612f2538d3df into 301f476df2adc9532f12cced548b13e8/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/f40f452afc17415fb752b5c0e2a6e917_SeqId_44_) 2023-12-03 10:54:26,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mb8rubmbekn42u8cgc56i9gi5spc41hclhinl12vu6g3tehns4nfmikpelpq0uhp/family1/d304f907066d4966b9eb612f2538d3df 2023-12-03 10:54:26,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-12-03 10:54:26,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-12-03 10:54:26,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): 301f476df2adc9532f12cced548b13e8/family1 is initiating minor compaction 2023-12-03 10:54:26,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@54d78bed; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:26,067 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 301f476df2adc9532f12cced548b13e8/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:26,067 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/b2f76dbcfc124facaa6cefce86a10416, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/ac82881d03e64819ad1747f48701cb78, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/8b73e5279ec84819a9375ab130a0eefd, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/665244bd17cf4cf59505c99ab29e7d0b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/89e22ddf3b6d4e08b1e853f1875398b4, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/04901acbd71e479193cfe556f29e3b19, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38c0586f7a384e3589cedd8f8ed34d9a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/df69d99fca7b4cbfa5bc9218d049cbd0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38809f76cf3d434ebfe9b8206016c873, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/f40f452afc17415fb752b5c0e2a6e917_SeqId_44_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp, totalSize=50.4 K 2023-12-03 10:54:26,067 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting b2f76dbcfc124facaa6cefce86a10416, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-12-03 10:54:26,067 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting ac82881d03e64819ad1747f48701cb78, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-12-03 10:54:26,067 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 8b73e5279ec84819a9375ab130a0eefd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-12-03 10:54:26,067 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 665244bd17cf4cf59505c99ab29e7d0b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-12-03 10:54:26,067 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 89e22ddf3b6d4e08b1e853f1875398b4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-12-03 10:54:26,067 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 04901acbd71e479193cfe556f29e3b19, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-12-03 10:54:26,067 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 38c0586f7a384e3589cedd8f8ed34d9a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-12-03 10:54:26,067 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting df69d99fca7b4cbfa5bc9218d049cbd0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-12-03 10:54:26,067 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 38809f76cf3d434ebfe9b8206016c873, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-12-03 10:54:26,067 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting f40f452afc17415fb752b5c0e2a6e917_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-12-03 10:54:26,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:26,069 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:26,071 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512286525d93f6f9b4666a7be686712d41324 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512286525d93f6f9b4666a7be686712d41324 2023-12-03 10:54:26,072 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512312533b857959d4468b781e8fb04aeddef to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512312533b857959d4468b781e8fb04aeddef 2023-12-03 10:54:26,074 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101abd74dbb72f2457989773046e06631f9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101abd74dbb72f2457989773046e06631f9 2023-12-03 10:54:26,075 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010313937bc239ad4c27a0c30ec703fdd93b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010313937bc239ad4c27a0c30ec703fdd93b 2023-12-03 10:54:26,075 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-12-03 10:54:26,075 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-12-03 10:54:26,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:26,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:26,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:26,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:26,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:26,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:26,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:26,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:26,100 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 301f476df2adc9532f12cced548b13e8#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:54:26,536 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/94f5480bfbf546febe766f76442138de as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/94f5480bfbf546febe766f76442138de 2023-12-03 10:54:26,542 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 301f476df2adc9532f12cced548b13e8/family1 of 301f476df2adc9532f12cced548b13e8 into 94f5480bfbf546febe766f76442138de(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:54:26,542 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:26,542 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1701600866066; duration=0sec 2023-12-03 10:54:26,542 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:26,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/b2f76dbcfc124facaa6cefce86a10416, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/ac82881d03e64819ad1747f48701cb78, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/8b73e5279ec84819a9375ab130a0eefd, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/665244bd17cf4cf59505c99ab29e7d0b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/89e22ddf3b6d4e08b1e853f1875398b4, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/04901acbd71e479193cfe556f29e3b19, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38c0586f7a384e3589cedd8f8ed34d9a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/df69d99fca7b4cbfa5bc9218d049cbd0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38809f76cf3d434ebfe9b8206016c873, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/f40f452afc17415fb752b5c0e2a6e917_SeqId_44_] to archive 2023-12-03 10:54:26,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:26,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/b2f76dbcfc124facaa6cefce86a10416 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/b2f76dbcfc124facaa6cefce86a10416 2023-12-03 10:54:26,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/ac82881d03e64819ad1747f48701cb78 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/ac82881d03e64819ad1747f48701cb78 2023-12-03 10:54:26,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/8b73e5279ec84819a9375ab130a0eefd to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/8b73e5279ec84819a9375ab130a0eefd 2023-12-03 10:54:26,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/665244bd17cf4cf59505c99ab29e7d0b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/665244bd17cf4cf59505c99ab29e7d0b 2023-12-03 10:54:26,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/89e22ddf3b6d4e08b1e853f1875398b4 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/89e22ddf3b6d4e08b1e853f1875398b4 2023-12-03 10:54:26,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/04901acbd71e479193cfe556f29e3b19 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/04901acbd71e479193cfe556f29e3b19 2023-12-03 10:54:26,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38c0586f7a384e3589cedd8f8ed34d9a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38c0586f7a384e3589cedd8f8ed34d9a 2023-12-03 10:54:26,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/df69d99fca7b4cbfa5bc9218d049cbd0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/df69d99fca7b4cbfa5bc9218d049cbd0 2023-12-03 10:54:26,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38809f76cf3d434ebfe9b8206016c873 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/38809f76cf3d434ebfe9b8206016c873 2023-12-03 10:54:26,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/f40f452afc17415fb752b5c0e2a6e917_SeqId_44_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/f40f452afc17415fb752b5c0e2a6e917_SeqId_44_ 2023-12-03 10:54:26,940 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059ea83ceeb3694d2bac2012cbc20bb312 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512059ea83ceeb3694d2bac2012cbc20bb312 2023-12-03 10:54:26,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:26,964 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9499f6c894c74392a4c9ea2b9d7e4da6 first=Optional[r00] last=Optional[r2] 2023-12-03 10:54:26,965 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9499f6c894c74392a4c9ea2b9d7e4da6}] 2023-12-03 10:54:26,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9499f6c894c74392a4c9ea2b9d7e4da6 for inclusion in 301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:26,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-12-03 10:54:26,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:54:26,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:26,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9499f6c894c74392a4c9ea2b9d7e4da6 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__q5hasrl68s22504g7srlsv3o17fn8hc3kovfo4vk8dh6dgqqsgc6egt4rs5abduf/family1/9499f6c894c74392a4c9ea2b9d7e4da6 2023-12-03 10:54:26,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__q5hasrl68s22504g7srlsv3o17fn8hc3kovfo4vk8dh6dgqqsgc6egt4rs5abduf/family1/9499f6c894c74392a4c9ea2b9d7e4da6 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/4983158a344148148c36ebef4704f003_SeqId_47_ 2023-12-03 10:54:26,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__q5hasrl68s22504g7srlsv3o17fn8hc3kovfo4vk8dh6dgqqsgc6egt4rs5abduf/family1/9499f6c894c74392a4c9ea2b9d7e4da6 into 301f476df2adc9532f12cced548b13e8/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/4983158a344148148c36ebef4704f003_SeqId_47_ - updating store file list. 2023-12-03 10:54:26,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/4983158a344148148c36ebef4704f003_SeqId_47_ into 301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:26,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__q5hasrl68s22504g7srlsv3o17fn8hc3kovfo4vk8dh6dgqqsgc6egt4rs5abduf/family1/9499f6c894c74392a4c9ea2b9d7e4da6 into 301f476df2adc9532f12cced548b13e8/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/4983158a344148148c36ebef4704f003_SeqId_47_) 2023-12-03 10:54:26,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__q5hasrl68s22504g7srlsv3o17fn8hc3kovfo4vk8dh6dgqqsgc6egt4rs5abduf/family1/9499f6c894c74392a4c9ea2b9d7e4da6 2023-12-03 10:54:26,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-12-03 10:54:26,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-12-03 10:54:26,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): 301f476df2adc9532f12cced548b13e8/family1 is initiating minor compaction (all files) 2023-12-03 10:54:26,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6ded17d0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:26,980 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 301f476df2adc9532f12cced548b13e8/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:26,980 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/adae1bddfee14c0da20e3c0fced7f599, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/94f5480bfbf546febe766f76442138de, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/4983158a344148148c36ebef4704f003_SeqId_47_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp, totalSize=390.1 K 2023-12-03 10:54:26,981 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting adae1bddfee14c0da20e3c0fced7f599, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823227 2023-12-03 10:54:26,981 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 94f5480bfbf546febe766f76442138de, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223227 2023-12-03 10:54:26,982 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 4983158a344148148c36ebef4704f003_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823227 2023-12-03 10:54:26,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:26,983 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:26,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130704440fc7355454ea63b49e3912de328 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130704440fc7355454ea63b49e3912de328 2023-12-03 10:54:26,985 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512012a296029a7904f16accca8f89e698fff to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512012a296029a7904f16accca8f89e698fff 2023-12-03 10:54:26,987 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512057eec24669bb744a6886c143e46e4f5bb to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512057eec24669bb744a6886c143e46e4f5bb 2023-12-03 10:54:26,987 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-12-03 10:54:26,987 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-12-03 10:54:26,987 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:26,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:26,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:26,988 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-12-03 10:54:26,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4510 sec 2023-12-03 10:54:27,005 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 301f476df2adc9532f12cced548b13e8#family1#compaction#62 average throughput is 15.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:54:27,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-12-03 10:54:27,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:27,424 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/.tmp/family1/9fc5c340a63c4cf3a68d80acf5c7fd99 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/9fc5c340a63c4cf3a68d80acf5c7fd99 2023-12-03 10:54:27,429 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 301f476df2adc9532f12cced548b13e8/family1 of 301f476df2adc9532f12cced548b13e8 into 9fc5c340a63c4cf3a68d80acf5c7fd99(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:54:27,429 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:27,429 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1701600866980; duration=0sec 2023-12-03 10:54:27,429 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:27,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/adae1bddfee14c0da20e3c0fced7f599, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/94f5480bfbf546febe766f76442138de, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/4983158a344148148c36ebef4704f003_SeqId_47_] to archive 2023-12-03 10:54:27,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:27,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/adae1bddfee14c0da20e3c0fced7f599 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/adae1bddfee14c0da20e3c0fced7f599 2023-12-03 10:54:27,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/94f5480bfbf546febe766f76442138de to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/94f5480bfbf546febe766f76442138de 2023-12-03 10:54:27,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/4983158a344148148c36ebef4704f003_SeqId_47_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/4983158a344148148c36ebef4704f003_SeqId_47_ 2023-12-03 10:54:27,483 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-12-03 10:54:27,484 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-12-03 10:54:27,484 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-12-03 10:54:27,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-12-03 10:54:27,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, REOPEN/MOVE}] 2023-12-03 10:54:27,488 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, REOPEN/MOVE 2023-12-03 10:54:27,489 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=301f476df2adc9532f12cced548b13e8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:27,489 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600867489"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600867489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600867489"}]},"ts":"1701600867489"} 2023-12-03 10:54:27,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 301f476df2adc9532f12cced548b13e8, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:27,642 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:27,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:27,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 301f476df2adc9532f12cced548b13e8, disabling compactions & flushes 2023-12-03 10:54:27,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:27,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:27,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. after waiting 0 ms 2023-12-03 10:54:27,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:27,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-12-03 10:54:27,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:27,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:27,649 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 301f476df2adc9532f12cced548b13e8 to self. 2023-12-03 10:54:27,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:27,651 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=301f476df2adc9532f12cced548b13e8, regionState=CLOSED 2023-12-03 10:54:27,651 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600867651"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600867651"}]},"ts":"1701600867651"} 2023-12-03 10:54:27,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=46, resume processing ppid=45 2023-12-03 10:54:27,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 301f476df2adc9532f12cced548b13e8, server=jenkins-hbase4.apache.org,44259,1701600798821 in 162 msec 2023-12-03 10:54:27,654 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=true 2023-12-03 10:54:27,804 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=301f476df2adc9532f12cced548b13e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:27,805 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600867804"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600867804"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600867804"}]},"ts":"1701600867804"} 2023-12-03 10:54:27,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 301f476df2adc9532f12cced548b13e8, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:27,958 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:27,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:27,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 301f476df2adc9532f12cced548b13e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:54:27,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:27,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:27,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:27,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:27,963 INFO [StoreOpener-301f476df2adc9532f12cced548b13e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:27,965 DEBUG [StoreOpener-301f476df2adc9532f12cced548b13e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:27,965 DEBUG [StoreOpener-301f476df2adc9532f12cced548b13e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:27,965 INFO [StoreOpener-301f476df2adc9532f12cced548b13e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 301f476df2adc9532f12cced548b13e8 columnFamilyName family1 2023-12-03 10:54:27,970 DEBUG [StoreOpener-301f476df2adc9532f12cced548b13e8-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/9fc5c340a63c4cf3a68d80acf5c7fd99 2023-12-03 10:54:27,970 INFO [StoreOpener-301f476df2adc9532f12cced548b13e8-1] regionserver.HStore(310): Store=301f476df2adc9532f12cced548b13e8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:27,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:27,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:27,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:27,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 301f476df2adc9532f12cced548b13e8; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65453975, jitterRate=-0.024659767746925354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:54:27,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:27,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8., pid=47, masterSystemTime=1701600867958 2023-12-03 10:54:27,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:27,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:27,978 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=301f476df2adc9532f12cced548b13e8, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:27,978 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600867978"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600867978"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600867978"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600867978"}]},"ts":"1701600867978"} 2023-12-03 10:54:27,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=47, resume processing ppid=45 2023-12-03 10:54:27,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 301f476df2adc9532f12cced548b13e8, server=jenkins-hbase4.apache.org,44259,1701600798821 in 174 msec 2023-12-03 10:54:27,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=45, resume processing ppid=44 2023-12-03 10:54:27,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, REOPEN/MOVE in 493 msec 2023-12-03 10:54:27,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=44, resume processing ppid=43 2023-12-03 10:54:27,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 497 msec 2023-12-03 10:54:27,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 912 msec 2023-12-03 10:54:27,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-12-03 10:54:27,988 INFO [Listener at localhost/33475] compactions.TestMobCompactor(278): alter status finished 2023-12-03 10:54:27,989 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:27,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-12-03 10:54:27,993 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-12-03 10:54:27,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:27,993 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601467993 2023-12-03 10:54:27,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:54:27,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-12-03 10:54:27,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:27,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x073b76db to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:54:28,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c33d5e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:54:28,009 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:28,009 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:28,010 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:28,010 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:28,010 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:28,837 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112880fc1b409c3d45ec8fb920c57f084be3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112880fc1b409c3d45ec8fb920c57f084be3 2023-12-03 10:54:28,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:28,851 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:54:28,852 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:54:28,859 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:54:28,861 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:54:28,869 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/08f077918c1548f1b18e3633c4ca9c96 first=Optional[r05] last=Optional[r8] 2023-12-03 10:54:28,870 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=51 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/08f077918c1548f1b18e3633c4ca9c96}] 2023-12-03 10:54:28,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/08f077918c1548f1b18e3633c4ca9c96 for inclusion in 301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:28,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-12-03 10:54:28,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:54:28,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:28,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/08f077918c1548f1b18e3633c4ca9c96 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__eeqj4i7qskvv252uuq702q5fl6cl6ik1h2dd0rk9vf8to3t2tkbvrirq8vhsa8ik/family1/08f077918c1548f1b18e3633c4ca9c96 2023-12-03 10:54:28,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__eeqj4i7qskvv252uuq702q5fl6cl6ik1h2dd0rk9vf8to3t2tkbvrirq8vhsa8ik/family1/08f077918c1548f1b18e3633c4ca9c96 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/2be43bc9e8484ee895def8425c9ff1b7_SeqId_53_ 2023-12-03 10:54:28,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__eeqj4i7qskvv252uuq702q5fl6cl6ik1h2dd0rk9vf8to3t2tkbvrirq8vhsa8ik/family1/08f077918c1548f1b18e3633c4ca9c96 into 301f476df2adc9532f12cced548b13e8/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/2be43bc9e8484ee895def8425c9ff1b7_SeqId_53_ - updating store file list. 2023-12-03 10:54:28,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/2be43bc9e8484ee895def8425c9ff1b7_SeqId_53_ into 301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:28,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__eeqj4i7qskvv252uuq702q5fl6cl6ik1h2dd0rk9vf8to3t2tkbvrirq8vhsa8ik/family1/08f077918c1548f1b18e3633c4ca9c96 into 301f476df2adc9532f12cced548b13e8/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/2be43bc9e8484ee895def8425c9ff1b7_SeqId_53_) 2023-12-03 10:54:28,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__eeqj4i7qskvv252uuq702q5fl6cl6ik1h2dd0rk9vf8to3t2tkbvrirq8vhsa8ik/family1/08f077918c1548f1b18e3633c4ca9c96 2023-12-03 10:54:28,889 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:28,889 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:28,891 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120224f6432751a4c1d82245fce4db1e443 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120224f6432751a4c1d82245fce4db1e443 2023-12-03 10:54:28,892 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128c152af345c9f4b8994423d954ff08c2d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128c152af345c9f4b8994423d954ff08c2d 2023-12-03 10:54:28,892 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-12-03 10:54:28,892 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-12-03 10:54:28,892 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:28,893 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:28,893 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:28,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:28,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:28,893 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-12-03 10:54:28,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 904 msec 2023-12-03 10:54:28,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-12-03 10:54:28,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:29,361 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-12-03 10:54:29,362 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-12-03 10:54:29,362 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-12-03 10:54:29,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-12-03 10:54:29,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, REOPEN/MOVE}] 2023-12-03 10:54:29,367 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, REOPEN/MOVE 2023-12-03 10:54:29,367 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=301f476df2adc9532f12cced548b13e8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:29,368 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600869367"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600869367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600869367"}]},"ts":"1701600869367"} 2023-12-03 10:54:29,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 301f476df2adc9532f12cced548b13e8, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:29,520 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:29,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:29,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 301f476df2adc9532f12cced548b13e8, disabling compactions & flushes 2023-12-03 10:54:29,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:29,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:29,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. after waiting 0 ms 2023-12-03 10:54:29,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:29,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-12-03 10:54:29,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:29,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:29,529 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 301f476df2adc9532f12cced548b13e8 to self. 2023-12-03 10:54:29,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:29,530 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=301f476df2adc9532f12cced548b13e8, regionState=CLOSED 2023-12-03 10:54:29,531 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600869530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600869530"}]},"ts":"1701600869530"} 2023-12-03 10:54:29,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=52, resume processing ppid=51 2023-12-03 10:54:29,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 301f476df2adc9532f12cced548b13e8, server=jenkins-hbase4.apache.org,44259,1701600798821 in 163 msec 2023-12-03 10:54:29,533 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=true 2023-12-03 10:54:29,684 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=301f476df2adc9532f12cced548b13e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:29,684 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600869684"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600869684"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600869684"}]},"ts":"1701600869684"} 2023-12-03 10:54:29,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 301f476df2adc9532f12cced548b13e8, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:29,838 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:29,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:29,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 301f476df2adc9532f12cced548b13e8, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:54:29,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:29,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:29,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:29,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:29,843 INFO [StoreOpener-301f476df2adc9532f12cced548b13e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:29,844 DEBUG [StoreOpener-301f476df2adc9532f12cced548b13e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:29,844 DEBUG [StoreOpener-301f476df2adc9532f12cced548b13e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1 2023-12-03 10:54:29,844 INFO [StoreOpener-301f476df2adc9532f12cced548b13e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 301f476df2adc9532f12cced548b13e8 columnFamilyName family1 2023-12-03 10:54:29,850 DEBUG [StoreOpener-301f476df2adc9532f12cced548b13e8-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/2be43bc9e8484ee895def8425c9ff1b7_SeqId_53_ 2023-12-03 10:54:29,852 DEBUG [StoreOpener-301f476df2adc9532f12cced548b13e8-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/family1/9fc5c340a63c4cf3a68d80acf5c7fd99 2023-12-03 10:54:29,853 INFO [StoreOpener-301f476df2adc9532f12cced548b13e8-1] regionserver.HStore(310): Store=301f476df2adc9532f12cced548b13e8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:29,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:29,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:29,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 301f476df2adc9532f12cced548b13e8 2023-12-03 10:54:29,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 301f476df2adc9532f12cced548b13e8; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59940670, jitterRate=-0.1068144142627716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:54:29,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:54:29,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8., pid=53, masterSystemTime=1701600869838 2023-12-03 10:54:29,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:29,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:54:29,860 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=301f476df2adc9532f12cced548b13e8, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:29,860 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701600869860"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600869860"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600869860"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600869860"}]},"ts":"1701600869860"} 2023-12-03 10:54:29,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=53, resume processing ppid=51 2023-12-03 10:54:29,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 301f476df2adc9532f12cced548b13e8, server=jenkins-hbase4.apache.org,44259,1701600798821 in 175 msec 2023-12-03 10:54:29,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=51, resume processing ppid=50 2023-12-03 10:54:29,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=301f476df2adc9532f12cced548b13e8, REOPEN/MOVE in 497 msec 2023-12-03 10:54:29,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=50, resume processing ppid=49 2023-12-03 10:54:29,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 501 msec 2023-12-03 10:54:29,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 917 msec 2023-12-03 10:54:29,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-12-03 10:54:29,870 INFO [Listener at localhost/33475] compactions.TestMobCompactor(278): alter status finished 2023-12-03 10:54:29,871 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-12-03 10:54:29,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-12-03 10:54:29,873 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-12-03 10:54:29,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:29,874 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601469874 2023-12-03 10:54:29,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:54:29,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-12-03 10:54:29,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:29,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x7be26f61 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:54:29,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@696c090c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:54:29,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:29,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:29,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:29,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:29,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:29,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:29,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:29,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-12-03 10:54:29,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-12-03 10:54:29,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:29,881 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-12-03 10:54:29,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-12-03 10:54:29,932 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=254 (was 264), OpenFileDescriptor=659 (was 648) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 211), ProcessCount=173 (was 173), AvailableMemoryMB=3237 (was 3256) 2023-12-03 10:54:29,944 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=254, OpenFileDescriptor=659, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=173, AvailableMemoryMB=3237 2023-12-03 10:54:29,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-12-03 10:54:29,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:29,949 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:54:29,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-12-03 10:54:29,949 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:54:29,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-12-03 10:54:29,951 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:29,951 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6 empty. 2023-12-03 10:54:29,952 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:29,952 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-12-03 10:54:30,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-12-03 10:54:30,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-12-03 10:54:30,359 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-12-03 10:54:30,360 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2e27303c5798e37a241debf9d11c54c6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:54:30,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-12-03 10:54:30,767 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:30,767 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 2e27303c5798e37a241debf9d11c54c6, disabling compactions & flushes 2023-12-03 10:54:30,767 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:30,767 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:30,767 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. after waiting 0 ms 2023-12-03 10:54:30,767 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:30,767 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:30,767 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:30,769 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:54:30,770 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600870770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600870770"}]},"ts":"1701600870770"} 2023-12-03 10:54:30,772 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-03 10:54:30,772 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:54:30,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600870772"}]},"ts":"1701600870772"} 2023-12-03 10:54:30,773 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-12-03 10:54:30,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, ASSIGN}] 2023-12-03 10:54:30,777 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, ASSIGN 2023-12-03 10:54:30,778 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:54:30,929 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=2e27303c5798e37a241debf9d11c54c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:30,929 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600870929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600870929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600870929"}]},"ts":"1701600870929"} 2023-12-03 10:54:30,931 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 2e27303c5798e37a241debf9d11c54c6, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:31,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-12-03 10:54:31,082 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:31,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:31,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2e27303c5798e37a241debf9d11c54c6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:54:31,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:31,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:31,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:31,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:31,087 INFO [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:31,088 DEBUG [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:31,088 DEBUG [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:31,088 INFO [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e27303c5798e37a241debf9d11c54c6 columnFamilyName family1 2023-12-03 10:54:31,090 INFO [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] regionserver.HStore(310): Store=2e27303c5798e37a241debf9d11c54c6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:31,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:31,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:31,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:31,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:54:31,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2e27303c5798e37a241debf9d11c54c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67014358, jitterRate=-0.0014082491397857666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:54:31,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:31,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6., pid=57, masterSystemTime=1701600871082 2023-12-03 10:54:31,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:31,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:31,099 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=2e27303c5798e37a241debf9d11c54c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:31,099 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600871099"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600871099"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600871099"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600871099"}]},"ts":"1701600871099"} 2023-12-03 10:54:31,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=57, resume processing ppid=56 2023-12-03 10:54:31,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 2e27303c5798e37a241debf9d11c54c6, server=jenkins-hbase4.apache.org,44259,1701600798821 in 169 msec 2023-12-03 10:54:31,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=56, resume processing ppid=55 2023-12-03 10:54:31,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, ASSIGN in 325 msec 2023-12-03 10:54:31,104 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:54:31,104 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600871104"}]},"ts":"1701600871104"} 2023-12-03 10:54:31,105 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-12-03 10:54:31,108 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:54:31,109 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1620 sec 2023-12-03 10:54:32,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-12-03 10:54:32,056 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-12-03 10:54:32,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:32,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,083 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:32,083 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:32,083 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-12-03 10:54:32,083 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-12-03 10:54:32,084 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,084 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,085 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:32,085 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:32,086 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,086 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,087 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,087 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-12-03 10:54:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-12-03 10:54:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:32,091 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:32,091 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. started... 2023-12-03 10:54:32,092 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2e27303c5798e37a241debf9d11c54c6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-12-03 10:54:32,219 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:32,517 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130883275a8652648a4acdcc663349af125 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130883275a8652648a4acdcc663349af125 2023-12-03 10:54:32,521 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/ebfe987acc0a454cabb4c84f0671788a 2023-12-03 10:54:32,525 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/ebfe987acc0a454cabb4c84f0671788a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ebfe987acc0a454cabb4c84f0671788a 2023-12-03 10:54:32,529 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ebfe987acc0a454cabb4c84f0671788a, entries=1000, sequenceid=5, filesize=190.5 K 2023-12-03 10:54:32,530 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 2e27303c5798e37a241debf9d11c54c6 in 438ms, sequenceid=5, compaction requested=false 2023-12-03 10:54:32,531 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:32,531 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:32,531 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:32,531 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:32,531 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,531 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-12-03 10:54:32,531 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-12-03 10:54:32,533 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,533 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:32,533 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,533 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:32,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:32,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:32,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-12-03 10:54:32,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1808f306[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:32,535 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-12-03 10:54:32,535 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,536 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-12-03 10:54:32,536 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-12-03 10:54:32,536 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:32,536 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,536 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:32,539 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-12-03 10:54:32,539 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,539 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:32,539 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-12-03 10:54:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:32,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-12-03 10:54:32,541 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-12-03 10:54:32,541 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:32,541 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:32,541 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,541 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:32,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:32,545 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:32,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:32,546 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:32,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,547 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:32,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:32,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,550 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:32,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:32,550 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:32,651 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:32,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:32,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:32,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:32,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,658 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:32,658 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:32,658 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-12-03 10:54:32,658 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-12-03 10:54:32,659 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,659 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,660 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:32,660 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:32,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:32,661 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:32,661 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:32,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:32,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,668 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-12-03 10:54:32,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-12-03 10:54:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-12-03 10:54:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:32,668 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:32,668 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:32,668 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. started... 2023-12-03 10:54:32,668 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2e27303c5798e37a241debf9d11c54c6 1/1 column families, dataSize=74 B heapSize=408 B 2023-12-03 10:54:32,690 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286eddef0429f5471ca9960b5804dcb32b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286eddef0429f5471ca9960b5804dcb32b 2023-12-03 10:54:33,099 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/ab4e25e9ff7d4cccacaa4087fb63a3de 2023-12-03 10:54:33,105 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/ab4e25e9ff7d4cccacaa4087fb63a3de as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ab4e25e9ff7d4cccacaa4087fb63a3de 2023-12-03 10:54:33,109 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ab4e25e9ff7d4cccacaa4087fb63a3de, entries=1, sequenceid=9, filesize=5.0 K 2023-12-03 10:54:33,110 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 2e27303c5798e37a241debf9d11c54c6 in 442ms, sequenceid=9, compaction requested=false 2023-12-03 10:54:33,110 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:33,110 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:33,110 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:33,110 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:33,110 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,110 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-12-03 10:54:33,110 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-12-03 10:54:33,112 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,112 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:33,112 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,112 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:33,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-12-03 10:54:33,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38ae53c7[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:33,114 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-12-03 10:54:33,114 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,116 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,117 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-12-03 10:54:33,117 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-12-03 10:54:33,117 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:33,117 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,117 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:33,118 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-12-03 10:54:33,118 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,118 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:33,118 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-12-03 10:54:33,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:33,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:33,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:33,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:33,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-12-03 10:54:33,121 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-12-03 10:54:33,121 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:33,121 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:33,121 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,121 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:33,122 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,122 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:33,122 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:33,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:33,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:33,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:33,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:33,123 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:33,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,124 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:33,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:33,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:33,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:33,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:33,127 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:33,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:33,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:33,127 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:33,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,127 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:33,127 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,128 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:33,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:33,192 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:54:33,228 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:33,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:33,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:33,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:33,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,234 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:33,234 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:33,234 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-12-03 10:54:33,234 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-12-03 10:54:33,234 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,235 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,237 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,237 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:33,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:33,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:33,238 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,238 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:33,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:33,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,239 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,239 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-12-03 10:54:33,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-12-03 10:54:33,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:33,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-12-03 10:54:33,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:33,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:33,239 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:33,239 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. started... 2023-12-03 10:54:33,240 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2e27303c5798e37a241debf9d11c54c6 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:33,254 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bb4255fd6e9a4db4ac080d3e8e54ff23 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201bb4255fd6e9a4db4ac080d3e8e54ff23 2023-12-03 10:54:33,259 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/7b723843dd014a0ba4d354d65dcb0da8 2023-12-03 10:54:33,264 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/7b723843dd014a0ba4d354d65dcb0da8 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/7b723843dd014a0ba4d354d65dcb0da8 2023-12-03 10:54:33,268 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/7b723843dd014a0ba4d354d65dcb0da8, entries=1, sequenceid=13, filesize=5.0 K 2023-12-03 10:54:33,269 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2e27303c5798e37a241debf9d11c54c6 in 29ms, sequenceid=13, compaction requested=true 2023-12-03 10:54:33,269 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:33,269 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:33,269 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:33,269 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:33,269 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,269 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-12-03 10:54:33,269 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-12-03 10:54:33,271 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,271 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:33,271 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,271 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:33,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-12-03 10:54:33,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c44506e[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:33,273 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-12-03 10:54:33,273 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,274 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,275 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-12-03 10:54:33,275 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,275 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:33,275 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-12-03 10:54:33,275 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:33,276 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-12-03 10:54:33,276 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,276 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:33,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:33,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:33,276 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-12-03 10:54:33,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:33,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:33,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:33,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-12-03 10:54:33,279 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-12-03 10:54:33,279 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:33,279 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:33,279 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,279 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:33,287 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,287 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,287 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:33,287 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:33,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,289 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:33,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,294 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,294 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,294 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,294 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:33,294 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:33,294 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:33,294 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:33,294 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,294 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-12-03 10:54:33,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:33,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:33,294 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:33,295 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:33,295 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:33,395 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:33,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:33,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:33,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:33,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,401 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:33,402 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:33,402 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-12-03 10:54:33,402 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-12-03 10:54:33,402 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,402 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,406 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:33,406 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:33,406 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:33,406 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:33,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:33,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,407 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,407 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-12-03 10:54:33,407 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:33,407 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-12-03 10:54:33,407 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:33,407 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-12-03 10:54:33,408 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:33,408 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:33,408 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:33,408 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. started... 2023-12-03 10:54:33,408 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2e27303c5798e37a241debf9d11c54c6 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:33,823 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e39eb377c811495aab951759c511213f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e39eb377c811495aab951759c511213f 2023-12-03 10:54:34,229 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/fdc39e4f45e24fbc8a9d8164fb760370 2023-12-03 10:54:34,234 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/fdc39e4f45e24fbc8a9d8164fb760370 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/fdc39e4f45e24fbc8a9d8164fb760370 2023-12-03 10:54:34,238 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/fdc39e4f45e24fbc8a9d8164fb760370, entries=1, sequenceid=17, filesize=5.0 K 2023-12-03 10:54:34,239 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2e27303c5798e37a241debf9d11c54c6 in 831ms, sequenceid=17, compaction requested=true 2023-12-03 10:54:34,239 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:34,239 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:34,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:34,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:34,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-12-03 10:54:34,239 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-12-03 10:54:34,242 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,242 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:34,242 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,242 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:34,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-12-03 10:54:34,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e2fbec1[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:34,244 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-12-03 10:54:34,244 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,246 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,246 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-12-03 10:54:34,246 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-12-03 10:54:34,246 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:34,246 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,246 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:34,248 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-12-03 10:54:34,248 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,248 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:34,248 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-12-03 10:54:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:34,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-12-03 10:54:34,250 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-12-03 10:54:34,250 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:34,250 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:34,250 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,250 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:34,252 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,253 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:34,253 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:34,253 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:34,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:34,255 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:34,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,258 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,258 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:34,258 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:34,258 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,258 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:34,258 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:34,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:34,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:34,258 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:34,259 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,259 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,259 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,259 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:34,259 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:34,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-12-03 10:54:34,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:34,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:34,359 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:34,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:34,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:34,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:34,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,366 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:34,366 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:34,366 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-12-03 10:54:34,366 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-12-03 10:54:34,367 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,367 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,369 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:34,369 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:34,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:34,369 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:34,369 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:34,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:34,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,370 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,371 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-12-03 10:54:34,371 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:34,371 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-12-03 10:54:34,371 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:34,371 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-12-03 10:54:34,371 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:34,371 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:34,371 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:34,371 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. started... 2023-12-03 10:54:34,371 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2e27303c5798e37a241debf9d11c54c6 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:34,785 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228207eb6596a8547ea9ba2db0b6b97bc9c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228207eb6596a8547ea9ba2db0b6b97bc9c 2023-12-03 10:54:35,191 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/9373d91c59a1433db4ac41782bf42c8b 2023-12-03 10:54:35,196 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/9373d91c59a1433db4ac41782bf42c8b as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9373d91c59a1433db4ac41782bf42c8b 2023-12-03 10:54:35,200 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9373d91c59a1433db4ac41782bf42c8b, entries=1, sequenceid=21, filesize=5.0 K 2023-12-03 10:54:35,201 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2e27303c5798e37a241debf9d11c54c6 in 830ms, sequenceid=21, compaction requested=true 2023-12-03 10:54:35,201 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:35,201 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-12-03 10:54:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-12-03 10:54:35,203 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,203 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:35,203 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,203 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:35,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:35,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:35,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-12-03 10:54:35,205 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-12-03 10:54:35,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51e0fcc1[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:35,205 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,206 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,206 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-12-03 10:54:35,206 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-12-03 10:54:35,207 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:35,207 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,207 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:35,213 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-12-03 10:54:35,213 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:35,213 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,213 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-12-03 10:54:35,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:35,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:35,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:35,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:35,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:35,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:35,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-12-03 10:54:35,216 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-12-03 10:54:35,216 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:35,216 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:35,216 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,216 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:35,218 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,218 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:35,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:35,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,218 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:35,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:35,218 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:35,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:35,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:35,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,220 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:35,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:35,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:35,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:35,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,223 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:35,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,223 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:35,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:35,324 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:35,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:35,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:35,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:35,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,330 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:35,330 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:35,330 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-12-03 10:54:35,330 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-12-03 10:54:35,331 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,331 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,332 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:35,332 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:35,333 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,333 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:35,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:35,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,334 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,334 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-12-03 10:54:35,334 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,334 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-12-03 10:54:35,334 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:35,334 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-12-03 10:54:35,334 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:35,334 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:35,334 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:35,334 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. started... 2023-12-03 10:54:35,334 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2e27303c5798e37a241debf9d11c54c6 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:35,348 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231348192ccaaa549cd9f811da2ad0d061b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231348192ccaaa549cd9f811da2ad0d061b 2023-12-03 10:54:35,375 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:54:35,375 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x685b3547 to 127.0.0.1:62442 2023-12-03 10:54:35,375 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:54:35,375 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7be26f61 to 127.0.0.1:62442 2023-12-03 10:54:35,375 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:54:35,375 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:54:35,375 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f633213 to 127.0.0.1:62442 2023-12-03 10:54:35,375 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:54:35,376 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:54:35,376 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48ad45a6 to 127.0.0.1:62442 2023-12-03 10:54:35,376 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:54:35,376 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:54:35,376 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x073b76db to 127.0.0.1:62442 2023-12-03 10:54:35,376 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:54:35,754 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/3c81794765494226b4e5ccda88595b5c 2023-12-03 10:54:35,759 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/3c81794765494226b4e5ccda88595b5c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/3c81794765494226b4e5ccda88595b5c 2023-12-03 10:54:35,765 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/3c81794765494226b4e5ccda88595b5c, entries=1, sequenceid=25, filesize=5.0 K 2023-12-03 10:54:35,766 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2e27303c5798e37a241debf9d11c54c6 in 432ms, sequenceid=25, compaction requested=true 2023-12-03 10:54:35,766 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:35,766 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:35,766 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:35,766 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:35,766 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,766 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-12-03 10:54:35,766 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-12-03 10:54:35,768 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,768 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:35,768 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:35,768 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:35,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:35,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:35,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-12-03 10:54:35,770 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-12-03 10:54:35,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b1abd51[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:35,770 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,772 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,773 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-12-03 10:54:35,773 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-12-03 10:54:35,773 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:35,773 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,773 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:35,774 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-12-03 10:54:35,774 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,774 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:35,774 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-12-03 10:54:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:35,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-12-03 10:54:35,777 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-12-03 10:54:35,777 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:35,777 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:35,777 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,777 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:35,779 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,779 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:35,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:35,779 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:35,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:35,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:35,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:35,780 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:35,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,781 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:35,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,784 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,784 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,784 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,784 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:35,784 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:35,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:35,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:35,784 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:35,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:35,784 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:35,784 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,785 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:35,785 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:35,785 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:35,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:35,785 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,885 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:35,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:35,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:35,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:35,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,892 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:35,892 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:35,892 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-12-03 10:54:35,892 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-12-03 10:54:35,892 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,892 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,895 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:35,895 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:35,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:35,895 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,895 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:35,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:35,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,896 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,896 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-12-03 10:54:35,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-12-03 10:54:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-12-03 10:54:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:35,896 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:35,897 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. started... 2023-12-03 10:54:35,897 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2e27303c5798e37a241debf9d11c54c6 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:35,914 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101afc9ff5d8147464d8db2b5b9a27aa038 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101afc9ff5d8147464d8db2b5b9a27aa038 2023-12-03 10:54:35,918 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/eb18e4a52db54b45aa6dabb3a6889bbf 2023-12-03 10:54:35,923 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/eb18e4a52db54b45aa6dabb3a6889bbf as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/eb18e4a52db54b45aa6dabb3a6889bbf 2023-12-03 10:54:35,927 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/eb18e4a52db54b45aa6dabb3a6889bbf, entries=1, sequenceid=29, filesize=5.0 K 2023-12-03 10:54:35,928 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2e27303c5798e37a241debf9d11c54c6 in 31ms, sequenceid=29, compaction requested=true 2023-12-03 10:54:35,928 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:35,928 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:35,928 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:35,928 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:35,928 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,928 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-12-03 10:54:35,928 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-12-03 10:54:35,930 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,930 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:35,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:35,931 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,931 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:35,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:35,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:35,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:35,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-12-03 10:54:35,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65a3597c[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:35,932 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-12-03 10:54:35,933 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,934 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,934 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-12-03 10:54:35,934 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-12-03 10:54:35,934 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:35,934 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,934 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:35,935 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-12-03 10:54:35,935 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:35,936 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,936 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-12-03 10:54:35,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:35,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:35,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:35,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:35,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:35,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:35,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-12-03 10:54:35,938 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-12-03 10:54:35,938 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:35,938 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:35,938 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,938 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:35,941 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,941 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:35,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:35,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,941 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:35,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:35,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:35,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:35,942 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,943 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:35,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,945 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,945 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:35,945 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:35,946 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,946 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:35,945 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:35,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:35,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:35,946 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:35,946 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,946 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,946 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:35,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-12-03 10:54:35,946 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:35,946 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:35,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:36,046 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:36,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:36,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:36,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:36,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,053 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:36,053 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:36,053 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-12-03 10:54:36,053 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-12-03 10:54:36,054 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,054 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,055 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:36,055 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:36,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:36,056 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,056 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:36,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:36,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,057 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,057 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-12-03 10:54:36,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,057 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-12-03 10:54:36,057 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:36,057 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-12-03 10:54:36,057 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:36,057 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:36,057 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:36,057 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. started... 2023-12-03 10:54:36,058 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2e27303c5798e37a241debf9d11c54c6 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:36,476 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037ee39aee81a84f54bd06c1b17d134353 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601037ee39aee81a84f54bd06c1b17d134353 2023-12-03 10:54:36,881 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/41e3554175424277941277a81ef4686f 2023-12-03 10:54:36,886 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/41e3554175424277941277a81ef4686f as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/41e3554175424277941277a81ef4686f 2023-12-03 10:54:36,890 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/41e3554175424277941277a81ef4686f, entries=1, sequenceid=33, filesize=5.0 K 2023-12-03 10:54:36,891 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2e27303c5798e37a241debf9d11c54c6 in 833ms, sequenceid=33, compaction requested=true 2023-12-03 10:54:36,891 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:36,891 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:36,891 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:36,891 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:36,891 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,891 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-12-03 10:54:36,892 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-12-03 10:54:36,893 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,893 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:36,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:36,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,894 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:36,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:36,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:36,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:36,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-12-03 10:54:36,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16893abf[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:36,895 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-12-03 10:54:36,895 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,899 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,900 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-12-03 10:54:36,900 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-12-03 10:54:36,900 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:36,900 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,900 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:36,901 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-12-03 10:54:36,901 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,901 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:36,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:36,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:36,901 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-12-03 10:54:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:36,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:36,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-12-03 10:54:36,904 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-12-03 10:54:36,904 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:36,904 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:36,904 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,904 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:36,905 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,905 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:36,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,905 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:36,906 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,907 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,910 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,910 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,910 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:36,910 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:36,910 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:36,910 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:36,910 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:36,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:36,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:36,910 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,910 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:36,910 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:36,911 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:36,911 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:36,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:36,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:37,011 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:37,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:37,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:37,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:37,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,017 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:37,017 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:37,017 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-12-03 10:54:37,017 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-12-03 10:54:37,018 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,018 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,020 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,020 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:37,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:37,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:37,020 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,020 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:37,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:37,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,021 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,021 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-12-03 10:54:37,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,022 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-12-03 10:54:37,022 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:37,022 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-12-03 10:54:37,022 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:37,022 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:37,022 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:37,022 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. started... 2023-12-03 10:54:37,022 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2e27303c5798e37a241debf9d11c54c6 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:37,434 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070c7360574ee44f20a725c69ada729b3f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509070c7360574ee44f20a725c69ada729b3f 2023-12-03 10:54:37,844 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/f881affd7875461397c49c0c3457e5ec 2023-12-03 10:54:37,849 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/f881affd7875461397c49c0c3457e5ec as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/f881affd7875461397c49c0c3457e5ec 2023-12-03 10:54:37,854 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/f881affd7875461397c49c0c3457e5ec, entries=1, sequenceid=37, filesize=5.0 K 2023-12-03 10:54:37,855 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2e27303c5798e37a241debf9d11c54c6 in 833ms, sequenceid=37, compaction requested=true 2023-12-03 10:54:37,855 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:37,855 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:37,855 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:37,855 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:37,855 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,855 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-12-03 10:54:37,855 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-12-03 10:54:37,857 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,857 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:37,857 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,857 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:37,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-12-03 10:54:37,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4059da5b[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:37,859 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-12-03 10:54:37,859 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,860 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,861 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-12-03 10:54:37,861 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-12-03 10:54:37,861 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:37,861 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,861 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:37,862 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-12-03 10:54:37,862 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:37,862 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,862 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-12-03 10:54:37,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:37,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:37,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:37,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:37,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:37,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:37,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-12-03 10:54:37,865 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-12-03 10:54:37,865 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:37,865 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:37,865 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,865 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:37,868 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,868 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,868 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:37,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:37,869 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:37,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:37,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:37,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,871 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:37,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,873 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,873 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,873 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,873 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,873 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,873 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:37,874 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:37,874 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:37,873 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,874 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:37,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:37,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:37,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-12-03 10:54:37,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:37,874 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:37,874 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:37,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:37,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:37,974 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:37,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:37,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:37,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:37,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,981 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:37,981 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:37,981 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-12-03 10:54:37,981 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-12-03 10:54:37,982 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,982 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,983 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:37,983 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:37,984 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:37,984 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,984 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,984 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-12-03 10:54:37,985 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:37,985 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-12-03 10:54:37,985 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:37,985 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-12-03 10:54:37,985 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:54:37,985 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:37,985 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:37,985 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. started... 2023-12-03 10:54:37,985 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2e27303c5798e37a241debf9d11c54c6 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:54:37,998 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120bed211cf6c664e78b69109bd5c3ae049 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bed211cf6c664e78b69109bd5c3ae049 2023-12-03 10:54:38,409 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/1b954c85016f4fd7b6d88843cf951ba0 2023-12-03 10:54:38,413 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/1b954c85016f4fd7b6d88843cf951ba0 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/1b954c85016f4fd7b6d88843cf951ba0 2023-12-03 10:54:38,416 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/1b954c85016f4fd7b6d88843cf951ba0, entries=1, sequenceid=41, filesize=5.0 K 2023-12-03 10:54:38,417 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2e27303c5798e37a241debf9d11c54c6 in 432ms, sequenceid=41, compaction requested=true 2023-12-03 10:54:38,417 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:38,417 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:54:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:54:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-12-03 10:54:38,418 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-12-03 10:54:38,419 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,419 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:38,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:38,420 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,420 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:38,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:38,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:38,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:38,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-12-03 10:54:38,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e671734[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:38,421 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-12-03 10:54:38,421 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,423 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,424 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-12-03 10:54:38,424 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-12-03 10:54:38,424 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:38,424 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,424 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:38,425 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-12-03 10:54:38,425 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,425 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:38,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:38,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:38,425 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-12-03 10:54:38,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:38,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:38,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:38,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:38,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-12-03 10:54:38,428 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-12-03 10:54:38,428 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:38,428 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:38,428 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,428 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:38,432 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,432 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,432 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:38,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:38,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:38,432 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,433 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,437 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:38,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-12-03 10:54:38,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:38,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:38,437 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:38,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:38,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:38,538 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:38,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:38,540 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:38,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-12-03 10:54:38,542 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-12-03 10:54:38,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:38,543 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601478543 2023-12-03 10:54:38,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:54:38,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-12-03 10:54:38,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:38,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x0eeed212 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:54:38,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c972cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:54:38,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:39,386 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010397fa371c2de541ff8fcded5de8864638 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010397fa371c2de541ff8fcded5de8864638 2023-12-03 10:54:39,387 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:39,400 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:54:39,401 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:54:39,408 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:54:39,409 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:54:39,417 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2769b9627035485490c5016282c03c92 first=Optional[r3] last=Optional[r6] 2023-12-03 10:54:39,417 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2769b9627035485490c5016282c03c92}] 2023-12-03 10:54:39,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2769b9627035485490c5016282c03c92 for inclusion in 2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:39,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-12-03 10:54:39,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:54:39,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:39,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2769b9627035485490c5016282c03c92 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__46vnp2sgvj0oktd5b418ufp4k3i55c3amvn4qk6fem47bt8gpo6udk89i4hmugb/family1/2769b9627035485490c5016282c03c92 2023-12-03 10:54:39,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__46vnp2sgvj0oktd5b418ufp4k3i55c3amvn4qk6fem47bt8gpo6udk89i4hmugb/family1/2769b9627035485490c5016282c03c92 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ff7b5306afc44cfe8dc0e6e1a909e5ac_SeqId_44_ 2023-12-03 10:54:39,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__46vnp2sgvj0oktd5b418ufp4k3i55c3amvn4qk6fem47bt8gpo6udk89i4hmugb/family1/2769b9627035485490c5016282c03c92 into 2e27303c5798e37a241debf9d11c54c6/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ff7b5306afc44cfe8dc0e6e1a909e5ac_SeqId_44_ - updating store file list. 2023-12-03 10:54:39,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ff7b5306afc44cfe8dc0e6e1a909e5ac_SeqId_44_ into 2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:39,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__46vnp2sgvj0oktd5b418ufp4k3i55c3amvn4qk6fem47bt8gpo6udk89i4hmugb/family1/2769b9627035485490c5016282c03c92 into 2e27303c5798e37a241debf9d11c54c6/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ff7b5306afc44cfe8dc0e6e1a909e5ac_SeqId_44_) 2023-12-03 10:54:39,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__46vnp2sgvj0oktd5b418ufp4k3i55c3amvn4qk6fem47bt8gpo6udk89i4hmugb/family1/2769b9627035485490c5016282c03c92 2023-12-03 10:54:39,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-12-03 10:54:39,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-12-03 10:54:39,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): 2e27303c5798e37a241debf9d11c54c6/family1 is initiating minor compaction 2023-12-03 10:54:39,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3787005c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:39,434 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2e27303c5798e37a241debf9d11c54c6/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:39,434 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ab4e25e9ff7d4cccacaa4087fb63a3de, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/7b723843dd014a0ba4d354d65dcb0da8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/fdc39e4f45e24fbc8a9d8164fb760370, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9373d91c59a1433db4ac41782bf42c8b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/3c81794765494226b4e5ccda88595b5c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/eb18e4a52db54b45aa6dabb3a6889bbf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/41e3554175424277941277a81ef4686f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/f881affd7875461397c49c0c3457e5ec, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/1b954c85016f4fd7b6d88843cf951ba0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ff7b5306afc44cfe8dc0e6e1a909e5ac_SeqId_44_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp, totalSize=50.3 K 2023-12-03 10:54:39,434 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting ab4e25e9ff7d4cccacaa4087fb63a3de, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-12-03 10:54:39,434 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 7b723843dd014a0ba4d354d65dcb0da8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-12-03 10:54:39,434 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting fdc39e4f45e24fbc8a9d8164fb760370, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-12-03 10:54:39,434 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 9373d91c59a1433db4ac41782bf42c8b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-12-03 10:54:39,434 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 3c81794765494226b4e5ccda88595b5c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-12-03 10:54:39,434 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting eb18e4a52db54b45aa6dabb3a6889bbf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-12-03 10:54:39,435 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 41e3554175424277941277a81ef4686f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-12-03 10:54:39,435 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting f881affd7875461397c49c0c3457e5ec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-12-03 10:54:39,435 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 1b954c85016f4fd7b6d88843cf951ba0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-12-03 10:54:39,435 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting ff7b5306afc44cfe8dc0e6e1a909e5ac_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-12-03 10:54:39,436 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:39,436 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:39,438 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228207eb6596a8547ea9ba2db0b6b97bc9c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228207eb6596a8547ea9ba2db0b6b97bc9c 2023-12-03 10:54:39,439 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231348192ccaaa549cd9f811da2ad0d061b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231348192ccaaa549cd9f811da2ad0d061b 2023-12-03 10:54:39,448 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101afc9ff5d8147464d8db2b5b9a27aa038 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101afc9ff5d8147464d8db2b5b9a27aa038 2023-12-03 10:54:39,449 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601037ee39aee81a84f54bd06c1b17d134353 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601037ee39aee81a84f54bd06c1b17d134353 2023-12-03 10:54:39,449 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-12-03 10:54:39,449 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-12-03 10:54:39,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:39,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:39,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:39,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:39,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:39,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:39,450 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:39,450 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:39,458 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2e27303c5798e37a241debf9d11c54c6#family1#compaction#73 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:54:40,276 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/e37ec6db11d441c685302bfc237fdf1d as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/e37ec6db11d441c685302bfc237fdf1d 2023-12-03 10:54:40,281 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 2e27303c5798e37a241debf9d11c54c6/family1 of 2e27303c5798e37a241debf9d11c54c6 into e37ec6db11d441c685302bfc237fdf1d(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:54:40,281 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:40,281 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1701600879434; duration=0sec 2023-12-03 10:54:40,281 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:40,294 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053bade720d9534346843bd742eb52a2f4 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512053bade720d9534346843bd742eb52a2f4 2023-12-03 10:54:40,295 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:40,323 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a7d4ce86aa743e0aca880418f63a0de first=Optional[r00] last=Optional[r2] 2023-12-03 10:54:40,324 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a7d4ce86aa743e0aca880418f63a0de}] 2023-12-03 10:54:40,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a7d4ce86aa743e0aca880418f63a0de for inclusion in 2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:40,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-12-03 10:54:40,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:54:40,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:40,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a7d4ce86aa743e0aca880418f63a0de to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gni842fp6iddhbdmbvr3lu0uu4fc9iokh63u416mhv9v2lcjagknqv16494m0f5k/family1/2a7d4ce86aa743e0aca880418f63a0de 2023-12-03 10:54:40,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gni842fp6iddhbdmbvr3lu0uu4fc9iokh63u416mhv9v2lcjagknqv16494m0f5k/family1/2a7d4ce86aa743e0aca880418f63a0de as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/63582a4c240f4b51a36c9b5d874db035_SeqId_47_ 2023-12-03 10:54:40,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gni842fp6iddhbdmbvr3lu0uu4fc9iokh63u416mhv9v2lcjagknqv16494m0f5k/family1/2a7d4ce86aa743e0aca880418f63a0de into 2e27303c5798e37a241debf9d11c54c6/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/63582a4c240f4b51a36c9b5d874db035_SeqId_47_ - updating store file list. 2023-12-03 10:54:40,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/63582a4c240f4b51a36c9b5d874db035_SeqId_47_ into 2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:40,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gni842fp6iddhbdmbvr3lu0uu4fc9iokh63u416mhv9v2lcjagknqv16494m0f5k/family1/2a7d4ce86aa743e0aca880418f63a0de into 2e27303c5798e37a241debf9d11c54c6/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/63582a4c240f4b51a36c9b5d874db035_SeqId_47_) 2023-12-03 10:54:40,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gni842fp6iddhbdmbvr3lu0uu4fc9iokh63u416mhv9v2lcjagknqv16494m0f5k/family1/2a7d4ce86aa743e0aca880418f63a0de 2023-12-03 10:54:40,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-12-03 10:54:40,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-12-03 10:54:40,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): 2e27303c5798e37a241debf9d11c54c6/family1 is initiating minor compaction (all files) 2023-12-03 10:54:40,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@72fc3149; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:40,337 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2e27303c5798e37a241debf9d11c54c6/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:40,337 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ebfe987acc0a454cabb4c84f0671788a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/e37ec6db11d441c685302bfc237fdf1d, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/63582a4c240f4b51a36c9b5d874db035_SeqId_47_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp, totalSize=388.1 K 2023-12-03 10:54:40,337 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting ebfe987acc0a454cabb4c84f0671788a, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823227 2023-12-03 10:54:40,338 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting e37ec6db11d441c685302bfc237fdf1d, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223227 2023-12-03 10:54:40,338 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 63582a4c240f4b51a36c9b5d874db035_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823227 2023-12-03 10:54:40,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:40,339 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:40,340 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130883275a8652648a4acdcc663349af125 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130883275a8652648a4acdcc663349af125 2023-12-03 10:54:40,342 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201bb4255fd6e9a4db4ac080d3e8e54ff23 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201bb4255fd6e9a4db4ac080d3e8e54ff23 2023-12-03 10:54:40,343 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e39eb377c811495aab951759c511213f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e39eb377c811495aab951759c511213f 2023-12-03 10:54:40,343 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-12-03 10:54:40,343 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-12-03 10:54:40,344 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:40,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:40,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:40,344 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-12-03 10:54:40,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8050 sec 2023-12-03 10:54:40,358 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2e27303c5798e37a241debf9d11c54c6#family1#compaction#74 average throughput is 14.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:54:40,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ab4e25e9ff7d4cccacaa4087fb63a3de, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/7b723843dd014a0ba4d354d65dcb0da8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/fdc39e4f45e24fbc8a9d8164fb760370, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9373d91c59a1433db4ac41782bf42c8b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/3c81794765494226b4e5ccda88595b5c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/eb18e4a52db54b45aa6dabb3a6889bbf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/41e3554175424277941277a81ef4686f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/f881affd7875461397c49c0c3457e5ec, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/1b954c85016f4fd7b6d88843cf951ba0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ff7b5306afc44cfe8dc0e6e1a909e5ac_SeqId_44_] to archive 2023-12-03 10:54:40,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:40,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ab4e25e9ff7d4cccacaa4087fb63a3de to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ab4e25e9ff7d4cccacaa4087fb63a3de 2023-12-03 10:54:40,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/7b723843dd014a0ba4d354d65dcb0da8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/7b723843dd014a0ba4d354d65dcb0da8 2023-12-03 10:54:40,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/fdc39e4f45e24fbc8a9d8164fb760370 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/fdc39e4f45e24fbc8a9d8164fb760370 2023-12-03 10:54:40,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9373d91c59a1433db4ac41782bf42c8b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9373d91c59a1433db4ac41782bf42c8b 2023-12-03 10:54:40,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/3c81794765494226b4e5ccda88595b5c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/3c81794765494226b4e5ccda88595b5c 2023-12-03 10:54:40,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/eb18e4a52db54b45aa6dabb3a6889bbf to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/eb18e4a52db54b45aa6dabb3a6889bbf 2023-12-03 10:54:40,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/41e3554175424277941277a81ef4686f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/41e3554175424277941277a81ef4686f 2023-12-03 10:54:40,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/f881affd7875461397c49c0c3457e5ec to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/f881affd7875461397c49c0c3457e5ec 2023-12-03 10:54:40,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/1b954c85016f4fd7b6d88843cf951ba0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/1b954c85016f4fd7b6d88843cf951ba0 2023-12-03 10:54:40,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ff7b5306afc44cfe8dc0e6e1a909e5ac_SeqId_44_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ff7b5306afc44cfe8dc0e6e1a909e5ac_SeqId_44_ 2023-12-03 10:54:40,395 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-12-03 10:54:40,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-12-03 10:54:40,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:40,849 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-12-03 10:54:40,850 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-12-03 10:54:40,851 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-12-03 10:54:40,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-12-03 10:54:40,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, REOPEN/MOVE}] 2023-12-03 10:54:40,855 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, REOPEN/MOVE 2023-12-03 10:54:40,855 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2e27303c5798e37a241debf9d11c54c6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:40,855 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600880855"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600880855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600880855"}]},"ts":"1701600880855"} 2023-12-03 10:54:40,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 2e27303c5798e37a241debf9d11c54c6, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:41,008 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:41,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:41,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2e27303c5798e37a241debf9d11c54c6, disabling compactions & flushes 2023-12-03 10:54:41,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:41,585 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/.tmp/family1/9c9d2babf21d4a80b3a7a9ab2b58d13d as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9c9d2babf21d4a80b3a7a9ab2b58d13d 2023-12-03 10:54:41,589 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2e27303c5798e37a241debf9d11c54c6/family1 of 2e27303c5798e37a241debf9d11c54c6 into 9c9d2babf21d4a80b3a7a9ab2b58d13d(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:54:41,589 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:41,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:41,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:41,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. after waiting 0 ms 2023-12-03 10:54:41,589 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1701600880337; duration=1sec 2023-12-03 10:54:41,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:41,589 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:41,592 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ebfe987acc0a454cabb4c84f0671788a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/e37ec6db11d441c685302bfc237fdf1d, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/63582a4c240f4b51a36c9b5d874db035_SeqId_47_] to archive 2023-12-03 10:54:41,593 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:41,595 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ebfe987acc0a454cabb4c84f0671788a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/ebfe987acc0a454cabb4c84f0671788a 2023-12-03 10:54:41,596 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/e37ec6db11d441c685302bfc237fdf1d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/e37ec6db11d441c685302bfc237fdf1d 2023-12-03 10:54:41,597 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/63582a4c240f4b51a36c9b5d874db035_SeqId_47_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/63582a4c240f4b51a36c9b5d874db035_SeqId_47_ 2023-12-03 10:54:41,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-12-03 10:54:41,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:41,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:41,602 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 2e27303c5798e37a241debf9d11c54c6 to self. 2023-12-03 10:54:41,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:41,603 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2e27303c5798e37a241debf9d11c54c6, regionState=CLOSED 2023-12-03 10:54:41,604 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600881603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600881603"}]},"ts":"1701600881603"} 2023-12-03 10:54:41,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=62, resume processing ppid=61 2023-12-03 10:54:41,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 2e27303c5798e37a241debf9d11c54c6, server=jenkins-hbase4.apache.org,44259,1701600798821 in 748 msec 2023-12-03 10:54:41,606 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=true 2023-12-03 10:54:41,757 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2e27303c5798e37a241debf9d11c54c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:41,757 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600881757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600881757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600881757"}]},"ts":"1701600881757"} 2023-12-03 10:54:41,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 2e27303c5798e37a241debf9d11c54c6, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:41,910 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:41,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:41,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2e27303c5798e37a241debf9d11c54c6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:54:41,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:41,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:41,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:41,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:41,915 INFO [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:41,916 DEBUG [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:41,916 DEBUG [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:41,916 INFO [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e27303c5798e37a241debf9d11c54c6 columnFamilyName family1 2023-12-03 10:54:41,921 DEBUG [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9c9d2babf21d4a80b3a7a9ab2b58d13d 2023-12-03 10:54:41,921 INFO [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] regionserver.HStore(310): Store=2e27303c5798e37a241debf9d11c54c6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:41,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:41,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:41,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2e27303c5798e37a241debf9d11c54c6; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61554377, jitterRate=-0.08276830613613129}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:54:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:41,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6., pid=63, masterSystemTime=1701600881910 2023-12-03 10:54:41,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:41,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:41,929 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2e27303c5798e37a241debf9d11c54c6, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:41,929 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600881929"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600881929"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600881929"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600881929"}]},"ts":"1701600881929"} 2023-12-03 10:54:41,931 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=63, resume processing ppid=61 2023-12-03 10:54:41,931 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 2e27303c5798e37a241debf9d11c54c6, server=jenkins-hbase4.apache.org,44259,1701600798821 in 172 msec 2023-12-03 10:54:41,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=61, resume processing ppid=60 2023-12-03 10:54:41,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, REOPEN/MOVE in 1.0770 sec 2023-12-03 10:54:41,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=60, resume processing ppid=59 2023-12-03 10:54:41,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0810 sec 2023-12-03 10:54:41,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.4950 sec 2023-12-03 10:54:41,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-12-03 10:54:41,937 INFO [Listener at localhost/33475] compactions.TestMobCompactor(278): alter status finished 2023-12-03 10:54:41,938 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:41,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-12-03 10:54:41,940 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-12-03 10:54:41,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:41,940 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601481940 2023-12-03 10:54:41,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:54:41,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-12-03 10:54:41,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:41,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x1d4650a1 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:54:41,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b5408f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:54:41,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:41,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:41,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:41,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:41,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:42,774 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286d18b730897c4cbebd9dfae1404b9759 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286d18b730897c4cbebd9dfae1404b9759 2023-12-03 10:54:42,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:42,795 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:54:42,796 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:54:42,803 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:54:42,805 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:54:42,814 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34b434068b7a4e7289af3e9c19e50c3b first=Optional[r05] last=Optional[r8] 2023-12-03 10:54:42,815 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=51 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34b434068b7a4e7289af3e9c19e50c3b}] 2023-12-03 10:54:42,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34b434068b7a4e7289af3e9c19e50c3b for inclusion in 2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:42,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-12-03 10:54:42,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:54:42,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:42,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34b434068b7a4e7289af3e9c19e50c3b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tis6ccs7hqfujfd73i942hdbgs5mrhftac1nssn7p0htabjcarvvmguov1c2fl39/family1/34b434068b7a4e7289af3e9c19e50c3b 2023-12-03 10:54:42,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tis6ccs7hqfujfd73i942hdbgs5mrhftac1nssn7p0htabjcarvvmguov1c2fl39/family1/34b434068b7a4e7289af3e9c19e50c3b as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9dd654413a074f938ec9f28fb3b55b04_SeqId_53_ 2023-12-03 10:54:42,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tis6ccs7hqfujfd73i942hdbgs5mrhftac1nssn7p0htabjcarvvmguov1c2fl39/family1/34b434068b7a4e7289af3e9c19e50c3b into 2e27303c5798e37a241debf9d11c54c6/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9dd654413a074f938ec9f28fb3b55b04_SeqId_53_ - updating store file list. 2023-12-03 10:54:42,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9dd654413a074f938ec9f28fb3b55b04_SeqId_53_ into 2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:42,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tis6ccs7hqfujfd73i942hdbgs5mrhftac1nssn7p0htabjcarvvmguov1c2fl39/family1/34b434068b7a4e7289af3e9c19e50c3b into 2e27303c5798e37a241debf9d11c54c6/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9dd654413a074f938ec9f28fb3b55b04_SeqId_53_) 2023-12-03 10:54:42,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tis6ccs7hqfujfd73i942hdbgs5mrhftac1nssn7p0htabjcarvvmguov1c2fl39/family1/34b434068b7a4e7289af3e9c19e50c3b 2023-12-03 10:54:42,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:42,831 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:42,833 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bed211cf6c664e78b69109bd5c3ae049 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bed211cf6c664e78b69109bd5c3ae049 2023-12-03 10:54:42,834 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286eddef0429f5471ca9960b5804dcb32b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286eddef0429f5471ca9960b5804dcb32b 2023-12-03 10:54:42,834 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-12-03 10:54:42,834 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-12-03 10:54:42,834 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:42,834 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:42,834 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:42,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:42,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:42,835 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-12-03 10:54:42,836 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 897 msec 2023-12-03 10:54:42,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-12-03 10:54:42,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:43,299 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-12-03 10:54:43,301 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-12-03 10:54:43,301 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-12-03 10:54:43,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-12-03 10:54:43,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, REOPEN/MOVE}] 2023-12-03 10:54:43,304 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, REOPEN/MOVE 2023-12-03 10:54:43,305 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2e27303c5798e37a241debf9d11c54c6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:43,305 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600883305"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600883305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600883305"}]},"ts":"1701600883305"} 2023-12-03 10:54:43,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 2e27303c5798e37a241debf9d11c54c6, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:43,457 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:43,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:43,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2e27303c5798e37a241debf9d11c54c6, disabling compactions & flushes 2023-12-03 10:54:43,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:43,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:43,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. after waiting 0 ms 2023-12-03 10:54:43,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:43,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-12-03 10:54:43,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:43,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:43,466 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 2e27303c5798e37a241debf9d11c54c6 to self. 2023-12-03 10:54:43,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:43,468 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2e27303c5798e37a241debf9d11c54c6, regionState=CLOSED 2023-12-03 10:54:43,468 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600883468"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600883468"}]},"ts":"1701600883468"} 2023-12-03 10:54:43,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=68, resume processing ppid=67 2023-12-03 10:54:43,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 2e27303c5798e37a241debf9d11c54c6, server=jenkins-hbase4.apache.org,44259,1701600798821 in 163 msec 2023-12-03 10:54:43,470 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=true 2023-12-03 10:54:43,621 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2e27303c5798e37a241debf9d11c54c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:43,621 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600883621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600883621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600883621"}]},"ts":"1701600883621"} 2023-12-03 10:54:43,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 2e27303c5798e37a241debf9d11c54c6, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:43,774 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:43,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:43,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2e27303c5798e37a241debf9d11c54c6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:54:43,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:43,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:43,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:43,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:43,778 INFO [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:43,779 DEBUG [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:43,779 DEBUG [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1 2023-12-03 10:54:43,779 INFO [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e27303c5798e37a241debf9d11c54c6 columnFamilyName family1 2023-12-03 10:54:43,784 DEBUG [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9c9d2babf21d4a80b3a7a9ab2b58d13d 2023-12-03 10:54:43,787 DEBUG [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/family1/9dd654413a074f938ec9f28fb3b55b04_SeqId_53_ 2023-12-03 10:54:43,787 INFO [StoreOpener-2e27303c5798e37a241debf9d11c54c6-1] regionserver.HStore(310): Store=2e27303c5798e37a241debf9d11c54c6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:43,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:43,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:43,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:54:43,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2e27303c5798e37a241debf9d11c54c6; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67755081, jitterRate=0.009629383683204651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:54:43,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:54:43,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6., pid=69, masterSystemTime=1701600883774 2023-12-03 10:54:43,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:43,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:54:43,795 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2e27303c5798e37a241debf9d11c54c6, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:43,795 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701600883795"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600883795"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600883795"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600883795"}]},"ts":"1701600883795"} 2023-12-03 10:54:43,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=69, resume processing ppid=67 2023-12-03 10:54:43,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 2e27303c5798e37a241debf9d11c54c6, server=jenkins-hbase4.apache.org,44259,1701600798821 in 174 msec 2023-12-03 10:54:43,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=67, resume processing ppid=66 2023-12-03 10:54:43,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2e27303c5798e37a241debf9d11c54c6, REOPEN/MOVE in 493 msec 2023-12-03 10:54:43,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=66, resume processing ppid=65 2023-12-03 10:54:43,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 497 msec 2023-12-03 10:54:43,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 911 msec 2023-12-03 10:54:43,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-12-03 10:54:43,802 INFO [Listener at localhost/33475] compactions.TestMobCompactor(278): alter status finished 2023-12-03 10:54:43,803 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-12-03 10:54:43,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-12-03 10:54:43,805 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-12-03 10:54:43,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:43,806 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601483806 2023-12-03 10:54:43,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:54:43,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-12-03 10:54:43,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:43,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x5317278e to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:54:43,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@768339f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:54:43,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:43,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:43,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:43,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:43,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:43,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:43,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:43,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-12-03 10:54:43,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-12-03 10:54:43,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:43,813 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-12-03 10:54:43,814 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-12-03 10:54:43,860 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=246 (was 254), OpenFileDescriptor=650 (was 659), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=198 (was 206), ProcessCount=172 (was 173), AvailableMemoryMB=3203 (was 3237) 2023-12-03 10:54:43,872 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=246, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=198, ProcessCount=172, AvailableMemoryMB=3203 2023-12-03 10:54:43,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-12-03 10:54:43,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-12-03 10:54:43,878 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:54:43,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-12-03 10:54:43,878 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:54:43,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-12-03 10:54:43,880 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:43,880 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee empty. 2023-12-03 10:54:43,881 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:43,881 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-12-03 10:54:43,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-12-03 10:54:44,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-12-03 10:54:44,289 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-12-03 10:54:44,290 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => d40648ad8a5e264300076fa43a7a15ee, NAME => 'testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:54:44,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-12-03 10:54:44,696 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:44,696 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing d40648ad8a5e264300076fa43a7a15ee, disabling compactions & flushes 2023-12-03 10:54:44,696 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:44,696 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:44,696 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. after waiting 0 ms 2023-12-03 10:54:44,696 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:44,696 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:44,696 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for d40648ad8a5e264300076fa43a7a15ee: 2023-12-03 10:54:44,698 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:54:44,699 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701600884699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600884699"}]},"ts":"1701600884699"} 2023-12-03 10:54:44,700 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-03 10:54:44,701 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:54:44,701 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600884701"}]},"ts":"1701600884701"} 2023-12-03 10:54:44,702 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-12-03 10:54:44,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d40648ad8a5e264300076fa43a7a15ee, ASSIGN}] 2023-12-03 10:54:44,706 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d40648ad8a5e264300076fa43a7a15ee, ASSIGN 2023-12-03 10:54:44,706 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=d40648ad8a5e264300076fa43a7a15ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:54:44,857 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d40648ad8a5e264300076fa43a7a15ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:44,858 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701600884857"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600884857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600884857"}]},"ts":"1701600884857"} 2023-12-03 10:54:44,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure d40648ad8a5e264300076fa43a7a15ee, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:44,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-12-03 10:54:45,011 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:45,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:45,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d40648ad8a5e264300076fa43a7a15ee, NAME => 'testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:54:45,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-12-03 10:54:45,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-12-03 10:54:45,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:45,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:45,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:45,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:45,017 INFO [StoreOpener-d40648ad8a5e264300076fa43a7a15ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:45,018 DEBUG [StoreOpener-d40648ad8a5e264300076fa43a7a15ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1 2023-12-03 10:54:45,018 DEBUG [StoreOpener-d40648ad8a5e264300076fa43a7a15ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1 2023-12-03 10:54:45,019 INFO [StoreOpener-d40648ad8a5e264300076fa43a7a15ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d40648ad8a5e264300076fa43a7a15ee columnFamilyName f1 2023-12-03 10:54:45,020 INFO [StoreOpener-d40648ad8a5e264300076fa43a7a15ee-1] regionserver.HStore(310): Store=d40648ad8a5e264300076fa43a7a15ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:45,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:45,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:45,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:45,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:54:45,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d40648ad8a5e264300076fa43a7a15ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60689858, jitterRate=-0.09565064311027527}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:54:45,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d40648ad8a5e264300076fa43a7a15ee: 2023-12-03 10:54:45,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee., pid=73, masterSystemTime=1701600885011 2023-12-03 10:54:45,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:45,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:45,027 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d40648ad8a5e264300076fa43a7a15ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:45,027 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701600885027"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600885027"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600885027"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600885027"}]},"ts":"1701600885027"} 2023-12-03 10:54:45,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=73, resume processing ppid=72 2023-12-03 10:54:45,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure d40648ad8a5e264300076fa43a7a15ee, server=jenkins-hbase4.apache.org,44259,1701600798821 in 169 msec 2023-12-03 10:54:45,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=72, resume processing ppid=71 2023-12-03 10:54:45,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=d40648ad8a5e264300076fa43a7a15ee, ASSIGN in 325 msec 2023-12-03 10:54:45,031 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:54:45,031 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600885031"}]},"ts":"1701600885031"} 2023-12-03 10:54:45,032 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-12-03 10:54:45,034 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:54:45,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1580 sec 2023-12-03 10:54:45,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-12-03 10:54:45,984 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-12-03 10:54:45,984 DEBUG [Listener at localhost/33475] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-12-03 10:54:45,986 INFO [Listener at localhost/33475] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-03 10:54:45,988 INFO [Listener at localhost/33475] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-12-03 10:54:45,989 INFO [Listener at localhost/33475] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-03 10:54:45,989 INFO [Listener at localhost/33475] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-12-03 10:54:45,993 INFO [Listener at localhost/33475] regionserver.HRegion(2745): Flushing d40648ad8a5e264300076fa43a7a15ee 1/1 column families, dataSize=37 B heapSize=368 B 2023-12-03 10:54:46,405 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312033bbae2b460184f7988482f04d243907a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202312033bbae2b460184f7988482f04d243907a 2023-12-03 10:54:46,751 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5317278e to 127.0.0.1:62442 2023-12-03 10:54:46,751 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:54:46,751 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:54:46,751 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0eeed212 to 127.0.0.1:62442 2023-12-03 10:54:46,751 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:54:46,751 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:54:46,751 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d4650a1 to 127.0.0.1:62442 2023-12-03 10:54:46,751 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:54:46,751 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-12-03 10:54:46,811 INFO [Listener at localhost/33475] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/.tmp/f1/a1ce34b837504e0392e3b1870d5216c4 2023-12-03 10:54:46,818 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/.tmp/f1/a1ce34b837504e0392e3b1870d5216c4 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4 2023-12-03 10:54:46,823 INFO [Listener at localhost/33475] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4, entries=1, sequenceid=5, filesize=4.9 K 2023-12-03 10:54:46,824 INFO [Listener at localhost/33475] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for d40648ad8a5e264300076fa43a7a15ee in 831ms, sequenceid=5, compaction requested=false 2023-12-03 10:54:46,824 DEBUG [Listener at localhost/33475] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-12-03 10:54:46,825 DEBUG [Listener at localhost/33475] regionserver.HRegion(2446): Flush status journal for d40648ad8a5e264300076fa43a7a15ee: 2023-12-03 10:54:46,827 INFO [Listener at localhost/33475] regionserver.HRegion(2745): Flushing d40648ad8a5e264300076fa43a7a15ee 1/1 column families, dataSize=37 B heapSize=368 B 2023-12-03 10:54:47,242 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203074aa9af5c1d4c59ae93b1703a28fe18 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231203074aa9af5c1d4c59ae93b1703a28fe18 2023-12-03 10:54:47,281 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:54:47,648 INFO [Listener at localhost/33475] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/.tmp/f1/85ef0c844c254b4b92027a5ec83e7dc7 2023-12-03 10:54:47,653 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/.tmp/f1/85ef0c844c254b4b92027a5ec83e7dc7 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7 2023-12-03 10:54:47,656 INFO [Listener at localhost/33475] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7, entries=1, sequenceid=9, filesize=4.9 K 2023-12-03 10:54:47,657 INFO [Listener at localhost/33475] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for d40648ad8a5e264300076fa43a7a15ee in 830ms, sequenceid=9, compaction requested=false 2023-12-03 10:54:47,657 DEBUG [Listener at localhost/33475] regionserver.HRegion(2446): Flush status journal for d40648ad8a5e264300076fa43a7a15ee: 2023-12-03 10:54:47,659 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-12-03 10:54:47,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-12-03 10:54:47,661 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-12-03 10:54:47,662 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601487662 2023-12-03 10:54:47,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:47,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-12-03 10:54:47,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-12-03 10:54:47,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-12-03 10:54:47,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x72d8df77 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:54:47,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d7b3c6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:54:47,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231203 for table='testGetAfterCompaction' and column='f1' 2023-12-03 10:54:47,710 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,710 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,761 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,761 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,779 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-12-03 10:54:47,779 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-12-03 10:54:47,812 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,812 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,862 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,863 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,913 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,913 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,964 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:47,964 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,015 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,015 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,066 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,066 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,117 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,117 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,168 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,168 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,219 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,219 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,270 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,270 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,321 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,321 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,372 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,372 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,423 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,423 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,474 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,474 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,492 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312037425cab94e6e4ada812ad7d8b3cb39de to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202312037425cab94e6e4ada812ad7d8b3cb39de 2023-12-03 10:54:48,493 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231203 table='testGetAfterCompaction' column='f1' 2023-12-03 10:54:48,505 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:54:48,507 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:54:48,513 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:54:48,515 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:54:48,526 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,526 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,528 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231203/f1/90b12dd10661440d8e902b380c0613b1 first=Optional[r1] last=Optional[r2] 2023-12-03 10:54:48,528 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{f1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231203/f1/90b12dd10661440d8e902b380c0613b1}] 2023-12-03 10:54:48,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231203/f1/90b12dd10661440d8e902b380c0613b1 for inclusion in d40648ad8a5e264300076fa43a7a15ee/f1 2023-12-03 10:54:48,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-12-03 10:54:48,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:54:48,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for d40648ad8a5e264300076fa43a7a15ee: 2023-12-03 10:54:48,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231203/f1/90b12dd10661440d8e902b380c0613b1 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testGetAfterCompaction__5i4pkh9q9o1j1a9dq4161ko70425e0bcnhs727r3rsfl7et765j7fblaqbepqcsn/f1/90b12dd10661440d8e902b380c0613b1 2023-12-03 10:54:48,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testGetAfterCompaction__5i4pkh9q9o1j1a9dq4161ko70425e0bcnhs727r3rsfl7et765j7fblaqbepqcsn/f1/90b12dd10661440d8e902b380c0613b1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_ 2023-12-03 10:54:48,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testGetAfterCompaction__5i4pkh9q9o1j1a9dq4161ko70425e0bcnhs727r3rsfl7et765j7fblaqbepqcsn/f1/90b12dd10661440d8e902b380c0613b1 into d40648ad8a5e264300076fa43a7a15ee/f1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_ - updating store file list. 2023-12-03 10:54:48,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_ into d40648ad8a5e264300076fa43a7a15ee/f1 2023-12-03 10:54:48,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testGetAfterCompaction__5i4pkh9q9o1j1a9dq4161ko70425e0bcnhs727r3rsfl7et765j7fblaqbepqcsn/f1/90b12dd10661440d8e902b380c0613b1 into d40648ad8a5e264300076fa43a7a15ee/f1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_) 2023-12-03 10:54:48,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testGetAfterCompaction__5i4pkh9q9o1j1a9dq4161ko70425e0bcnhs727r3rsfl7et765j7fblaqbepqcsn/f1/90b12dd10661440d8e902b380c0613b1 2023-12-03 10:54:48,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): d40648ad8a5e264300076fa43a7a15ee/f1 is initiating minor compaction 2023-12-03 10:54:48,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@31d630b4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:48,543 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d40648ad8a5e264300076fa43a7a15ee/f1 in testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:48,543 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/.tmp, totalSize=10.0 K 2023-12-03 10:54:48,543 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 85ef0c844c254b4b92027a5ec83e7dc7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-12-03 10:54:48,543 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-12-03 10:54:48,545 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231203 table='testGetAfterCompaction' column='f1' 2023-12-03 10:54:48,548 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:48,550 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231203074aa9af5c1d4c59ae93b1703a28fe18 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231203074aa9af5c1d4c59ae93b1703a28fe18 2023-12-03 10:54:48,552 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202312033bbae2b460184f7988482f04d243907a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202312033bbae2b460184f7988482f04d243907a 2023-12-03 10:54:48,552 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-12-03 10:54:48,552 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231203' 2023-12-03 10:54:48,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231203 for table='testGetAfterCompaction' and column='f1' 2023-12-03 10:54:48,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-12-03 10:54:48,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:54:48,553 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-12-03 10:54:48,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 893 msec 2023-12-03 10:54:48,556 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): d40648ad8a5e264300076fa43a7a15ee#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:54:48,577 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,577 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,577 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:48,581 DEBUG [Listener at localhost/33475] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-12-03 10:54:48,585 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-12-03 10:54:48,585 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44259] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:48,586 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-12-03 10:54:48,586 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-12-03 10:54:48,586 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44259] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-12-03 10:54:48,586 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44259] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. because compaction request was cancelled 2023-12-03 10:54:48,638 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,638 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,638 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:48,689 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,690 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,690 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:48,740 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,741 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,741 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:48,792 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,792 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,792 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:48,843 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,843 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,843 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:48,894 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,894 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,894 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:48,945 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,945 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,945 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:48,996 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,996 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:48,996 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:49,047 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,047 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,047 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:49,098 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,098 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,098 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:49,149 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,149 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,149 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:49,200 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,200 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,200 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:49,251 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,251 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,251 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:49,301 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,302 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,302 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:49,352 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,353 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,353 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:49,371 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/.tmp/f1/04129aa081c444dcbd7292b223de82ca as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/04129aa081c444dcbd7292b223de82ca 2023-12-03 10:54:49,376 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in d40648ad8a5e264300076fa43a7a15ee/f1 of d40648ad8a5e264300076fa43a7a15ee into 04129aa081c444dcbd7292b223de82ca(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:54:49,376 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d40648ad8a5e264300076fa43a7a15ee: 2023-12-03 10:54:49,376 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1701600888542; duration=0sec 2023-12-03 10:54:49,376 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:54:49,403 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/04129aa081c444dcbd7292b223de82ca; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1701600889365; access_time=1701600888553; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,403 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,403 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,403 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:49,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_] to archive 2023-12-03 10:54:49,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:54:49,454 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/04129aa081c444dcbd7292b223de82ca; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1701600889365; access_time=1701600888553; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,454 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600887647; access_time=1701600886829; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,454 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,454 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701600888488; access_time=1701600887680; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-12-03 10:54:49,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/85ef0c844c254b4b92027a5ec83e7dc7 2023-12-03 10:54:49,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/ae1afe8247fa4f4a810ecac921ab1ac0_SeqId_12_ 2023-12-03 10:54:49,505 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/04129aa081c444dcbd7292b223de82ca; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1701600889365; access_time=1701600888553; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,505 INFO [Listener at localhost/33475] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701600886811; access_time=1701600885995; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-12-03 10:54:49,622 INFO [Listener at localhost/33475] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-12-03 10:54:49,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-12-03 10:54:49,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-12-03 10:54:49,635 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600889635"}]},"ts":"1701600889635"} 2023-12-03 10:54:49,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-12-03 10:54:49,637 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-12-03 10:54:49,639 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-12-03 10:54:49,640 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d40648ad8a5e264300076fa43a7a15ee, UNASSIGN}] 2023-12-03 10:54:49,641 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d40648ad8a5e264300076fa43a7a15ee, UNASSIGN 2023-12-03 10:54:49,642 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d40648ad8a5e264300076fa43a7a15ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:49,642 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701600889642"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600889642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600889642"}]},"ts":"1701600889642"} 2023-12-03 10:54:49,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure d40648ad8a5e264300076fa43a7a15ee, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:49,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-12-03 10:54:49,794 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:49,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:49,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d40648ad8a5e264300076fa43a7a15ee, disabling compactions & flushes 2023-12-03 10:54:49,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:49,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:49,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. after waiting 0 ms 2023-12-03 10:54:49,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:49,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-12-03 10:54:49,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-12-03 10:54:49,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee. 2023-12-03 10:54:49,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d40648ad8a5e264300076fa43a7a15ee: 2023-12-03 10:54:49,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:49,802 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d40648ad8a5e264300076fa43a7a15ee, regionState=CLOSED 2023-12-03 10:54:49,802 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701600889802"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600889802"}]},"ts":"1701600889802"} 2023-12-03 10:54:49,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=77, resume processing ppid=76 2023-12-03 10:54:49,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure d40648ad8a5e264300076fa43a7a15ee, server=jenkins-hbase4.apache.org,44259,1701600798821 in 160 msec 2023-12-03 10:54:49,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=76, resume processing ppid=75 2023-12-03 10:54:49,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=d40648ad8a5e264300076fa43a7a15ee, UNASSIGN in 165 msec 2023-12-03 10:54:49,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600889806"}]},"ts":"1701600889806"} 2023-12-03 10:54:49,807 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-12-03 10:54:49,809 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-12-03 10:54:49,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 181 msec 2023-12-03 10:54:49,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-12-03 10:54:49,939 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-12-03 10:54:49,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-12-03 10:54:49,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-12-03 10:54:49,951 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-12-03 10:54:49,952 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-12-03 10:54:49,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-12-03 10:54:49,955 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:49,958 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1, FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/recovered.edits] 2023-12-03 10:54:49,961 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/04129aa081c444dcbd7292b223de82ca to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/04129aa081c444dcbd7292b223de82ca 2023-12-03 10:54:49,962 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/f1/a1ce34b837504e0392e3b1870d5216c4 2023-12-03 10:54:49,966 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/recovered.edits/15.seqid to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee/recovered.edits/15.seqid 2023-12-03 10:54:49,966 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testGetAfterCompaction/d40648ad8a5e264300076fa43a7a15ee 2023-12-03 10:54:49,966 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-12-03 10:54:49,967 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-12-03 10:54:49,968 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-12-03 10:54:49,971 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202312037425cab94e6e4ada812ad7d8b3cb39de to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202312037425cab94e6e4ada812ad7d8b3cb39de 2023-12-03 10:54:49,972 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-12-03 10:54:49,974 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-12-03 10:54:49,996 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-12-03 10:54:49,999 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-12-03 10:54:50,000 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-12-03 10:54:50,000 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-12-03 10:54:50,000 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701600890000"}]},"ts":"9223372036854775807"} 2023-12-03 10:54:50,001 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-12-03 10:54:50,001 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d40648ad8a5e264300076fa43a7a15ee, NAME => 'testGetAfterCompaction,,1701600883875.d40648ad8a5e264300076fa43a7a15ee.', STARTKEY => '', ENDKEY => ''}] 2023-12-03 10:54:50,001 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-12-03 10:54:50,001 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1701600890001"}]},"ts":"9223372036854775807"} 2023-12-03 10:54:50,003 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-12-03 10:54:50,005 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-12-03 10:54:50,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 61 msec 2023-12-03 10:54:50,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-12-03 10:54:50,055 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-12-03 10:54:50,067 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=240 (was 246), OpenFileDescriptor=620 (was 650), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=183 (was 198), ProcessCount=170 (was 172), AvailableMemoryMB=3138 (was 3203) 2023-12-03 10:54:50,077 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=240, OpenFileDescriptor=620, MaxFileDescriptor=60000, SystemLoadAverage=183, ProcessCount=170, AvailableMemoryMB=3137 2023-12-03 10:54:50,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-12-03 10:54:50,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-12-03 10:54:50,081 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:54:50,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-12-03 10:54:50,082 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:54:50,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-12-03 10:54:50,084 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:54:50,084 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:54:50,085 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13 2023-12-03 10:54:50,085 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb empty. 2023-12-03 10:54:50,085 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7 empty. 2023-12-03 10:54:50,085 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13 empty. 2023-12-03 10:54:50,085 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:54:50,086 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:54:50,086 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13 2023-12-03 10:54:50,086 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-12-03 10:54:50,099 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-12-03 10:54:50,101 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4132a9cb8c9f3da44edb46b737bab3eb, NAME => 'testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:54:50,101 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8b5495b1604bfe1ccf77f0ddde66fab7, NAME => 'testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:54:50,105 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 165139cb0d2367959816aa2994261e13, NAME => 'testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:54:50,124 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:50,125 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 8b5495b1604bfe1ccf77f0ddde66fab7, disabling compactions & flushes 2023-12-03 10:54:50,125 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:50,125 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:50,125 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. after waiting 0 ms 2023-12-03 10:54:50,125 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:50,125 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:50,125 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:54:50,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-12-03 10:54:50,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-12-03 10:54:50,521 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:50,521 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 165139cb0d2367959816aa2994261e13, disabling compactions & flushes 2023-12-03 10:54:50,521 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:50,521 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:50,522 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. after waiting 0 ms 2023-12-03 10:54:50,522 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:50,522 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:50,522 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:54:50,527 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:50,527 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 4132a9cb8c9f3da44edb46b737bab3eb, disabling compactions & flushes 2023-12-03 10:54:50,527 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:50,527 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:50,527 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. after waiting 0 ms 2023-12-03 10:54:50,527 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:50,527 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:50,527 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:54:50,529 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:54:50,530 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600890530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600890530"}]},"ts":"1701600890530"} 2023-12-03 10:54:50,530 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600890530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600890530"}]},"ts":"1701600890530"} 2023-12-03 10:54:50,530 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600890530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600890530"}]},"ts":"1701600890530"} 2023-12-03 10:54:50,532 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-12-03 10:54:50,533 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:54:50,533 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600890533"}]},"ts":"1701600890533"} 2023-12-03 10:54:50,534 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-12-03 10:54:50,540 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, ASSIGN}] 2023-12-03 10:54:50,541 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, ASSIGN 2023-12-03 10:54:50,541 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, ASSIGN 2023-12-03 10:54:50,541 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, ASSIGN 2023-12-03 10:54:50,542 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:54:50,542 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:54:50,542 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:54:50,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-12-03 10:54:50,693 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=165139cb0d2367959816aa2994261e13, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:50,693 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8b5495b1604bfe1ccf77f0ddde66fab7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:50,693 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=4132a9cb8c9f3da44edb46b737bab3eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:50,693 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600890693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600890693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600890693"}]},"ts":"1701600890693"} 2023-12-03 10:54:50,694 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600890693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600890693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600890693"}]},"ts":"1701600890693"} 2023-12-03 10:54:50,694 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600890693"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600890693"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600890693"}]},"ts":"1701600890693"} 2023-12-03 10:54:50,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure 165139cb0d2367959816aa2994261e13, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:50,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 4132a9cb8c9f3da44edb46b737bab3eb, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:50,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 8b5495b1604bfe1ccf77f0ddde66fab7, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:54:50,848 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:50,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:50,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 165139cb0d2367959816aa2994261e13, NAME => 'testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.', STARTKEY => '2', ENDKEY => ''} 2023-12-03 10:54:50,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 165139cb0d2367959816aa2994261e13 2023-12-03 10:54:50,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:50,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 165139cb0d2367959816aa2994261e13 2023-12-03 10:54:50,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 165139cb0d2367959816aa2994261e13 2023-12-03 10:54:50,852 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 165139cb0d2367959816aa2994261e13 2023-12-03 10:54:50,854 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1 2023-12-03 10:54:50,854 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1 2023-12-03 10:54:50,854 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 165139cb0d2367959816aa2994261e13 columnFamilyName family1 2023-12-03 10:54:50,855 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(310): Store=165139cb0d2367959816aa2994261e13/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:50,856 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 165139cb0d2367959816aa2994261e13 2023-12-03 10:54:50,857 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2 2023-12-03 10:54:50,857 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2 2023-12-03 10:54:50,857 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 165139cb0d2367959816aa2994261e13 columnFamilyName family2 2023-12-03 10:54:50,858 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(310): Store=165139cb0d2367959816aa2994261e13/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:50,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13 2023-12-03 10:54:50,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13 2023-12-03 10:54:50,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:54:50,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 165139cb0d2367959816aa2994261e13 2023-12-03 10:54:50,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:54:50,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 165139cb0d2367959816aa2994261e13; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65707479, jitterRate=-0.020882263779640198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:54:50,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:54:50,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13., pid=83, masterSystemTime=1701600890848 2023-12-03 10:54:50,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:50,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:50,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:50,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8b5495b1604bfe1ccf77f0ddde66fab7, NAME => 'testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.', STARTKEY => '1', ENDKEY => '2'} 2023-12-03 10:54:50,866 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=165139cb0d2367959816aa2994261e13, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:50,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:54:50,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:50,866 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600890866"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600890866"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600890866"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600890866"}]},"ts":"1701600890866"} 2023-12-03 10:54:50,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:54:50,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:54:50,867 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:54:50,868 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1 2023-12-03 10:54:50,868 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1 2023-12-03 10:54:50,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=83, resume processing ppid=82 2023-12-03 10:54:50,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure 165139cb0d2367959816aa2994261e13, server=jenkins-hbase4.apache.org,44259,1701600798821 in 172 msec 2023-12-03 10:54:50,869 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b5495b1604bfe1ccf77f0ddde66fab7 columnFamilyName family1 2023-12-03 10:54:50,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, ASSIGN in 329 msec 2023-12-03 10:54:50,870 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(310): Store=8b5495b1604bfe1ccf77f0ddde66fab7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:50,870 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:54:50,871 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2 2023-12-03 10:54:50,871 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2 2023-12-03 10:54:50,871 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b5495b1604bfe1ccf77f0ddde66fab7 columnFamilyName family2 2023-12-03 10:54:50,872 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(310): Store=8b5495b1604bfe1ccf77f0ddde66fab7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:50,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:54:50,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:54:50,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:54:50,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:54:50,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:54:50,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8b5495b1604bfe1ccf77f0ddde66fab7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73550242, jitterRate=0.09598401188850403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:54:50,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:54:50,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7., pid=85, masterSystemTime=1701600890848 2023-12-03 10:54:50,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:50,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:50,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:50,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4132a9cb8c9f3da44edb46b737bab3eb, NAME => 'testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.', STARTKEY => '', ENDKEY => '1'} 2023-12-03 10:54:50,879 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8b5495b1604bfe1ccf77f0ddde66fab7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:50,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:54:50,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:54:50,879 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600890879"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600890879"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600890879"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600890879"}]},"ts":"1701600890879"} 2023-12-03 10:54:50,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:54:50,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:54:50,880 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:54:50,881 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1 2023-12-03 10:54:50,881 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1 2023-12-03 10:54:50,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=85, resume processing ppid=81 2023-12-03 10:54:50,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 8b5495b1604bfe1ccf77f0ddde66fab7, server=jenkins-hbase4.apache.org,44259,1701600798821 in 184 msec 2023-12-03 10:54:50,882 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4132a9cb8c9f3da44edb46b737bab3eb columnFamilyName family1 2023-12-03 10:54:50,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, ASSIGN in 343 msec 2023-12-03 10:54:50,883 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(310): Store=4132a9cb8c9f3da44edb46b737bab3eb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:50,883 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:54:50,884 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2 2023-12-03 10:54:50,884 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2 2023-12-03 10:54:50,885 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4132a9cb8c9f3da44edb46b737bab3eb columnFamilyName family2 2023-12-03 10:54:50,885 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(310): Store=4132a9cb8c9f3da44edb46b737bab3eb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:54:50,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:54:50,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:54:50,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:54:50,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:54:50,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:54:50,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4132a9cb8c9f3da44edb46b737bab3eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60656066, jitterRate=-0.09615418314933777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:54:50,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:54:50,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb., pid=84, masterSystemTime=1701600890848 2023-12-03 10:54:50,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:50,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:50,893 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=4132a9cb8c9f3da44edb46b737bab3eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:50,893 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600890893"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600890893"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600890893"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600890893"}]},"ts":"1701600890893"} 2023-12-03 10:54:50,893 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46307] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase4.apache.org,44259,1701600798821, table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-12-03 10:54:50,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=84, resume processing ppid=80 2023-12-03 10:54:50,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 4132a9cb8c9f3da44edb46b737bab3eb, server=jenkins-hbase4.apache.org,44259,1701600798821 in 199 msec 2023-12-03 10:54:50,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=80, resume processing ppid=79 2023-12-03 10:54:50,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, ASSIGN in 356 msec 2023-12-03 10:54:50,897 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:54:50,897 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600890897"}]},"ts":"1701600890897"} 2023-12-03 10:54:50,898 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-12-03 10:54:50,900 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:54:50,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 821 msec 2023-12-03 10:54:51,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-12-03 10:54:51,187 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-12-03 10:54:51,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:51,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:51,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:51,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:51,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-12-03 10:54:51,202 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-12-03 10:54:51,202 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:51,202 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-12-03 10:54:51,202 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-12-03 10:54:51,202 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:51,202 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:51,204 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:51,204 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:51,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:51,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:51,204 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:51,204 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:51,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:51,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:51,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:51,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:51,205 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-12-03 10:54:51,205 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-12-03 10:54:51,206 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-12-03 10:54:51,206 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:51,206 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-12-03 10:54:51,207 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:51,207 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:51,207 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:54:51,207 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:51,207 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. started... 2023-12-03 10:54:51,207 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. started... 2023-12-03 10:54:51,207 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:51,208 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. started... 2023-12-03 10:54:51,208 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 4132a9cb8c9f3da44edb46b737bab3eb 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-12-03 10:54:51,208 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 165139cb0d2367959816aa2994261e13 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-12-03 10:54:51,208 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b5495b1604bfe1ccf77f0ddde66fab7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-12-03 10:54:51,627 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312037a6f50af4b3b4f2e99a9393ff2828675 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312037a6f50af4b3b4f2e99a9393ff2828675 2023-12-03 10:54:51,628 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312039a55e318e7bf4043a874a621d150e375 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312039a55e318e7bf4043a874a621d150e375 2023-12-03 10:54:51,630 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312032fb3e8a0e9f24fdcba1bbdd826ea7960 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312032fb3e8a0e9f24fdcba1bbdd826ea7960 2023-12-03 10:54:51,635 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/e43b3fa2b8e5474881d0759f01b6c5d3 2023-12-03 10:54:51,647 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312034ace4a2d14a94cceb436febcb8170301 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202312034ace4a2d14a94cceb436febcb8170301 2023-12-03 10:54:52,034 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/e0d4934c6dbd45169ffa0078c6990601 2023-12-03 10:54:52,034 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/4dc65ae32dcf44af959362ea68bf3693 2023-12-03 10:54:52,051 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/4530ade4e6bb4a5893f6ffa53f9542c8 2023-12-03 10:54:52,055 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/e43b3fa2b8e5474881d0759f01b6c5d3 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/e43b3fa2b8e5474881d0759f01b6c5d3 2023-12-03 10:54:52,058 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/e43b3fa2b8e5474881d0759f01b6c5d3, entries=4, sequenceid=5, filesize=5.4 K 2023-12-03 10:54:52,059 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/4530ade4e6bb4a5893f6ffa53f9542c8 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/4530ade4e6bb4a5893f6ffa53f9542c8 2023-12-03 10:54:52,062 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/4530ade4e6bb4a5893f6ffa53f9542c8, entries=2, sequenceid=5, filesize=5.1 K 2023-12-03 10:54:52,063 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8b5495b1604bfe1ccf77f0ddde66fab7 in 855ms, sequenceid=5, compaction requested=false 2023-12-03 10:54:52,063 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-12-03 10:54:52,064 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:54:52,064 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:52,064 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:54:52,450 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203deebbb38791d49cca29a2d1e22566035 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231203deebbb38791d49cca29a2d1e22566035 2023-12-03 10:54:52,450 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203fbe086cd531e44b9a4b1ccf4957fb618 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231203fbe086cd531e44b9a4b1ccf4957fb618 2023-12-03 10:54:52,455 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/4f668439be874cd7b85324d646f88bcf 2023-12-03 10:54:52,459 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/e0d4934c6dbd45169ffa0078c6990601 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e0d4934c6dbd45169ffa0078c6990601 2023-12-03 10:54:52,462 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e0d4934c6dbd45169ffa0078c6990601, entries=4, sequenceid=5, filesize=5.4 K 2023-12-03 10:54:52,463 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/4f668439be874cd7b85324d646f88bcf as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/4f668439be874cd7b85324d646f88bcf 2023-12-03 10:54:52,466 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/4f668439be874cd7b85324d646f88bcf, entries=2, sequenceid=5, filesize=5.1 K 2023-12-03 10:54:52,467 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 165139cb0d2367959816aa2994261e13 in 1259ms, sequenceid=5, compaction requested=false 2023-12-03 10:54:52,468 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:54:52,468 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:52,468 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:54:52,855 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/d529de4a505142ff8bd105432af5436a 2023-12-03 10:54:52,860 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/4dc65ae32dcf44af959362ea68bf3693 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/4dc65ae32dcf44af959362ea68bf3693 2023-12-03 10:54:52,864 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/4dc65ae32dcf44af959362ea68bf3693, entries=4, sequenceid=5, filesize=5.4 K 2023-12-03 10:54:52,864 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/d529de4a505142ff8bd105432af5436a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/d529de4a505142ff8bd105432af5436a 2023-12-03 10:54:52,869 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/d529de4a505142ff8bd105432af5436a, entries=2, sequenceid=5, filesize=5.1 K 2023-12-03 10:54:52,870 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4132a9cb8c9f3da44edb46b737bab3eb in 1662ms, sequenceid=5, compaction requested=false 2023-12-03 10:54:52,870 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:54:52,870 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:54:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:54:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-12-03 10:54:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-12-03 10:54:52,872 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,872 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:52,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:52,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:52,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:52,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:52,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:52,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-12-03 10:54:52,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7170d73d[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:52,874 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-12-03 10:54:52,875 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:52,881 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:52,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:52,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-12-03 10:54:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-12-03 10:54:52,881 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:52,882 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,882 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:52,883 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-12-03 10:54:52,883 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,883 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:52,883 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-12-03 10:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:52,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:52,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:52,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-12-03 10:54:52,885 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-12-03 10:54:52,885 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:52,885 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:52,885 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-12-03 10:54:52,886 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:52,887 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:52,887 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:52,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:52,887 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:52,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:52,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:52,888 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:52,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:52,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:52,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:52,889 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:52,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:52,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,891 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,891 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:52,891 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:52,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-12-03 10:54:52,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:52,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-12-03 10:54:52,892 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:52,892 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:52,892 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:52,892 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:52,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:52,892 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:52,892 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:52,892 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:52,892 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:52,892 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:52,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:52,992 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:52,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:52,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:52,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:52,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:52,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:52,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:52,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-12-03 10:54:53,000 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-12-03 10:54:53,000 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:53,000 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-12-03 10:54:53,000 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-12-03 10:54:53,000 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:53,000 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:53,003 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:53,003 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:53,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:53,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:53,003 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:53,003 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:53,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:53,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:53,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:53,004 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-12-03 10:54:53,004 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-12-03 10:54:53,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-12-03 10:54:53,004 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-12-03 10:54:53,005 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:53,005 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-12-03 10:54:53,008 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:53,008 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. started... 2023-12-03 10:54:53,008 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:53,008 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b5495b1604bfe1ccf77f0ddde66fab7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-12-03 10:54:53,008 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. started... 2023-12-03 10:54:53,009 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 4132a9cb8c9f3da44edb46b737bab3eb 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-12-03 10:54:53,013 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:54:53,013 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:53,013 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:53,013 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. started... 2023-12-03 10:54:53,013 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 165139cb0d2367959816aa2994261e13 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-12-03 10:54:53,439 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312037192e36becbf4d11b19a3d7dc71df0c5 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312037192e36becbf4d11b19a3d7dc71df0c5 2023-12-03 10:54:53,442 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312039fbb451648694461855b105224707bbe to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312039fbb451648694461855b105224707bbe 2023-12-03 10:54:53,450 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312037ff4a72cdd19407c9e22ccdbd0f0217c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312037ff4a72cdd19407c9e22ccdbd0f0217c 2023-12-03 10:54:53,453 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/944e31b1d3a0437794d9a87c2d52b596 2023-12-03 10:54:53,455 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/21fd338ec3974795a5b8da570805fdd6 2023-12-03 10:54:53,467 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023120326635d0343a54d5693b17c27ab74a7c8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023120326635d0343a54d5693b17c27ab74a7c8 2023-12-03 10:54:53,850 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/a30088f6b1f84470b5cfbe8c4a42815c 2023-12-03 10:54:53,867 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312037b4df1edcc8d43e4b93c55da18b24669 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202312037b4df1edcc8d43e4b93c55da18b24669 2023-12-03 10:54:53,872 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/38a7435be03a43f1a3d0d95e3b28cd49 2023-12-03 10:54:53,872 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/2fe25c047e0c45149cb46e91aff149f3 2023-12-03 10:54:53,876 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/944e31b1d3a0437794d9a87c2d52b596 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/944e31b1d3a0437794d9a87c2d52b596 2023-12-03 10:54:53,877 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/21fd338ec3974795a5b8da570805fdd6 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/21fd338ec3974795a5b8da570805fdd6 2023-12-03 10:54:53,881 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/944e31b1d3a0437794d9a87c2d52b596, entries=4, sequenceid=9, filesize=5.4 K 2023-12-03 10:54:53,881 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/21fd338ec3974795a5b8da570805fdd6, entries=4, sequenceid=9, filesize=5.4 K 2023-12-03 10:54:53,881 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/38a7435be03a43f1a3d0d95e3b28cd49 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/38a7435be03a43f1a3d0d95e3b28cd49 2023-12-03 10:54:53,882 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/2fe25c047e0c45149cb46e91aff149f3 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2fe25c047e0c45149cb46e91aff149f3 2023-12-03 10:54:53,885 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/38a7435be03a43f1a3d0d95e3b28cd49, entries=2, sequenceid=9, filesize=5.1 K 2023-12-03 10:54:53,886 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2fe25c047e0c45149cb46e91aff149f3, entries=2, sequenceid=9, filesize=5.1 K 2023-12-03 10:54:53,886 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 165139cb0d2367959816aa2994261e13 in 873ms, sequenceid=9, compaction requested=false 2023-12-03 10:54:53,886 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8b5495b1604bfe1ccf77f0ddde66fab7 in 878ms, sequenceid=9, compaction requested=false 2023-12-03 10:54:53,886 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:54:53,886 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:54:53,886 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:53,886 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:53,886 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:54:53,886 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:54:54,267 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312038bb541d7ff4448829894e1a78ce0d719 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202312038bb541d7ff4448829894e1a78ce0d719 2023-12-03 10:54:54,672 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/6c6974e9423f4bd9832f83c689cb3791 2023-12-03 10:54:54,677 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/a30088f6b1f84470b5cfbe8c4a42815c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/a30088f6b1f84470b5cfbe8c4a42815c 2023-12-03 10:54:54,680 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/a30088f6b1f84470b5cfbe8c4a42815c, entries=4, sequenceid=9, filesize=5.4 K 2023-12-03 10:54:54,681 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/6c6974e9423f4bd9832f83c689cb3791 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/6c6974e9423f4bd9832f83c689cb3791 2023-12-03 10:54:54,684 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/6c6974e9423f4bd9832f83c689cb3791, entries=2, sequenceid=9, filesize=5.1 K 2023-12-03 10:54:54,685 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4132a9cb8c9f3da44edb46b737bab3eb in 1677ms, sequenceid=9, compaction requested=false 2023-12-03 10:54:54,685 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:54:54,685 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:54,685 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:54:54,685 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:54:54,685 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,685 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-12-03 10:54:54,685 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-12-03 10:54:54,689 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,689 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:54,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:54,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:54,690 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:54,690 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:54,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:54,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:54,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:54,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:54,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-12-03 10:54:54,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ef3576e[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:54,691 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-12-03 10:54:54,691 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:54,692 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:54,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:54,692 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-12-03 10:54:54,692 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-12-03 10:54:54,692 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,692 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:54,692 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:54,695 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-12-03 10:54:54,695 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,695 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:54,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:54,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:54,695 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-12-03 10:54:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:54,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-12-03 10:54:54,698 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-12-03 10:54:54,698 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:54,698 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:54,698 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-12-03 10:54:54,698 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:54,700 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:54,700 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:54,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:54,700 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:54,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:54,701 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:54,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:54,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:54,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:54,702 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:54,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:54,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,704 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,704 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:54,704 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:54,704 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:54,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:54,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-12-03 10:54:54,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:54,704 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:54,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-12-03 10:54:54,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:54,704 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:54,704 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,705 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:54,705 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:54,705 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:54,705 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:54,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:54,705 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:54,805 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:54,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:54,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:54,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:54,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:54,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:54,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:54,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-12-03 10:54:54,812 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-12-03 10:54:54,812 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:54,812 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-12-03 10:54:54,812 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-12-03 10:54:54,812 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:54,812 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:54,814 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:54,814 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:54,814 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:54,814 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:54,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:54,815 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-12-03 10:54:54,816 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-12-03 10:54:54,816 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-12-03 10:54:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-12-03 10:54:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-12-03 10:54:54,816 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:54,816 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:54,816 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. started... 2023-12-03 10:54:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:54:54,816 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:54,816 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:54,816 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b5495b1604bfe1ccf77f0ddde66fab7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-12-03 10:54:54,816 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. started... 2023-12-03 10:54:54,816 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. started... 2023-12-03 10:54:54,817 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 4132a9cb8c9f3da44edb46b737bab3eb 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-12-03 10:54:54,817 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 165139cb0d2367959816aa2994261e13 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-12-03 10:54:54,834 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312035a81da2ec3204552a8c008e1f373ce9b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312035a81da2ec3204552a8c008e1f373ce9b 2023-12-03 10:54:55,233 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203dc84e0647c2b44d7957e38fc5977dcf6 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203dc84e0647c2b44d7957e38fc5977dcf6 2023-12-03 10:54:55,236 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203886c17d39a634a4a8d98490294e521ba to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231203886c17d39a634a4a8d98490294e521ba 2023-12-03 10:54:55,238 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/08c8f4ef453f455baf39084fbc2a539a 2023-12-03 10:54:55,241 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/5001cc7cdfde4476a5d577904b0bc169 2023-12-03 10:54:55,301 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:54:55,639 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/1b66cacb21f74e3d85e983e84323bf7c 2023-12-03 10:54:55,652 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203d307962ee0fe4328af05e8ef144c7ea5 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231203d307962ee0fe4328af05e8ef144c7ea5 2023-12-03 10:54:55,654 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312034857c26e327c400eafb094230a7a3bf0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202312034857c26e327c400eafb094230a7a3bf0 2023-12-03 10:54:55,657 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/7e7d2af92dfd467bb7a9fa912a9d7fd0 2023-12-03 10:54:55,659 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/b115aaf2ec834a13a00f46dabf38ebcf 2023-12-03 10:54:55,662 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/08c8f4ef453f455baf39084fbc2a539a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/08c8f4ef453f455baf39084fbc2a539a 2023-12-03 10:54:55,663 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/5001cc7cdfde4476a5d577904b0bc169 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/5001cc7cdfde4476a5d577904b0bc169 2023-12-03 10:54:55,665 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/08c8f4ef453f455baf39084fbc2a539a, entries=4, sequenceid=13, filesize=5.4 K 2023-12-03 10:54:55,666 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/7e7d2af92dfd467bb7a9fa912a9d7fd0 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/7e7d2af92dfd467bb7a9fa912a9d7fd0 2023-12-03 10:54:55,667 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/5001cc7cdfde4476a5d577904b0bc169, entries=4, sequenceid=13, filesize=5.4 K 2023-12-03 10:54:55,668 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/b115aaf2ec834a13a00f46dabf38ebcf as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/b115aaf2ec834a13a00f46dabf38ebcf 2023-12-03 10:54:55,672 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/7e7d2af92dfd467bb7a9fa912a9d7fd0, entries=2, sequenceid=13, filesize=5.1 K 2023-12-03 10:54:55,673 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 165139cb0d2367959816aa2994261e13 in 856ms, sequenceid=13, compaction requested=true 2023-12-03 10:54:55,673 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:54:55,673 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:55,673 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:54:55,673 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/b115aaf2ec834a13a00f46dabf38ebcf, entries=2, sequenceid=13, filesize=5.1 K 2023-12-03 10:54:55,674 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4132a9cb8c9f3da44edb46b737bab3eb in 858ms, sequenceid=13, compaction requested=true 2023-12-03 10:54:55,674 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:54:55,674 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:55,674 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:54:56,055 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203968fad6d458240b28c58470c9e8b5fa1 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203968fad6d458240b28c58470c9e8b5fa1 2023-12-03 10:54:56,461 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/022680dab498448682466b98407e4ca6 2023-12-03 10:54:56,466 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/1b66cacb21f74e3d85e983e84323bf7c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/1b66cacb21f74e3d85e983e84323bf7c 2023-12-03 10:54:56,469 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/1b66cacb21f74e3d85e983e84323bf7c, entries=4, sequenceid=13, filesize=5.4 K 2023-12-03 10:54:56,470 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/022680dab498448682466b98407e4ca6 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/022680dab498448682466b98407e4ca6 2023-12-03 10:54:56,474 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/022680dab498448682466b98407e4ca6, entries=2, sequenceid=13, filesize=5.1 K 2023-12-03 10:54:56,475 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8b5495b1604bfe1ccf77f0ddde66fab7 in 1659ms, sequenceid=13, compaction requested=true 2023-12-03 10:54:56,475 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:54:56,475 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:56,475 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:54:56,475 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:54:56,475 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,475 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-12-03 10:54:56,475 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-12-03 10:54:56,478 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,478 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:56,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:56,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:56,478 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:56,478 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:56,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:56,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:56,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:56,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:56,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-12-03 10:54:56,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20f6dbe9[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:56,480 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-12-03 10:54:56,480 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:56,481 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:56,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:56,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:56,481 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-12-03 10:54:56,481 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-12-03 10:54:56,481 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,482 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:56,481 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:56,483 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-12-03 10:54:56,483 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:56,483 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,483 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-12-03 10:54:56,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:56,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:56,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:56,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:56,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:56,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:56,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:56,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:56,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-12-03 10:54:56,485 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-12-03 10:54:56,485 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:56,485 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:56,485 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-12-03 10:54:56,485 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:56,487 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:56,487 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:56,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:56,487 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:56,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:56,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:56,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:56,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:56,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:56,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:56,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:56,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:56,488 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,489 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:56,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,492 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,492 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:56,492 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:56,493 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:56,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:56,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:56,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-12-03 10:54:56,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:56,492 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:56,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:56,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:56,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:56,493 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:56,493 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:56,493 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:56,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:56,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:56,593 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:56,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:56,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:56,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:56,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:54:56,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:54:56,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-12-03 10:54:56,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-12-03 10:54:56,600 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-12-03 10:54:56,600 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:56,600 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-12-03 10:54:56,600 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-12-03 10:54:56,601 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:56,601 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:56,602 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:56,602 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:56,603 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:56,603 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:56,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:54:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:56,604 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-12-03 10:54:56,604 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-12-03 10:54:56,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-12-03 10:54:56,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-12-03 10:54:56,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:54:56,604 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-12-03 10:54:56,607 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:56,607 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. started... 2023-12-03 10:54:56,607 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:54:56,607 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:54:56,607 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:56,607 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:56,607 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b5495b1604bfe1ccf77f0ddde66fab7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-12-03 10:54:56,608 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. started... 2023-12-03 10:54:56,607 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. started... 2023-12-03 10:54:56,608 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 165139cb0d2367959816aa2994261e13 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-12-03 10:54:56,608 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 4132a9cb8c9f3da44edb46b737bab3eb 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-12-03 10:54:56,629 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203d78c7071d96d44368c2354c38d0330ad to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203d78c7071d96d44368c2354c38d0330ad 2023-12-03 10:54:57,023 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312032e90e14765544c32aa3c367fafa64834 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312032e90e14765544c32aa3c367fafa64834 2023-12-03 10:54:57,026 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023120331a6522ef732428fb47c5cc2fc1cdd65 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023120331a6522ef732428fb47c5cc2fc1cdd65 2023-12-03 10:54:57,047 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/c2b878ed45eb4fe18d5b8a30ac1b6841 2023-12-03 10:54:57,430 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/dea52f33c07e401fb6278611b4368409 2023-12-03 10:54:57,448 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/c9a58476ea00423db2ca3619d93bd624 2023-12-03 10:54:57,461 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203da036c48ec8645ff823bc3f24c64e9b2 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203da036c48ec8645ff823bc3f24c64e9b2 2023-12-03 10:54:57,461 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023120331e7bdd6c5964091a592de5386f911d1 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023120331e7bdd6c5964091a592de5386f911d1 2023-12-03 10:54:57,779 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-12-03 10:54:57,844 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023120363ce55068854418f816d39d980e82224 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023120363ce55068854418f816d39d980e82224 2023-12-03 10:54:57,865 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/2215d1dbf9914e2480c0efd66c2a9e79 2023-12-03 10:54:57,866 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/2cc5a6f8db354cd8a7ae0ac3059a1832 2023-12-03 10:54:57,870 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/c9a58476ea00423db2ca3619d93bd624 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/c9a58476ea00423db2ca3619d93bd624 2023-12-03 10:54:57,870 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/c2b878ed45eb4fe18d5b8a30ac1b6841 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/c2b878ed45eb4fe18d5b8a30ac1b6841 2023-12-03 10:54:57,874 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/c9a58476ea00423db2ca3619d93bd624, entries=4, sequenceid=17, filesize=5.4 K 2023-12-03 10:54:57,874 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/c2b878ed45eb4fe18d5b8a30ac1b6841, entries=4, sequenceid=17, filesize=5.4 K 2023-12-03 10:54:57,875 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/2cc5a6f8db354cd8a7ae0ac3059a1832 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/2cc5a6f8db354cd8a7ae0ac3059a1832 2023-12-03 10:54:57,875 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/2215d1dbf9914e2480c0efd66c2a9e79 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2215d1dbf9914e2480c0efd66c2a9e79 2023-12-03 10:54:57,878 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/2cc5a6f8db354cd8a7ae0ac3059a1832, entries=2, sequenceid=17, filesize=5.1 K 2023-12-03 10:54:57,879 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2215d1dbf9914e2480c0efd66c2a9e79, entries=2, sequenceid=17, filesize=5.1 K 2023-12-03 10:54:57,879 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4132a9cb8c9f3da44edb46b737bab3eb in 1271ms, sequenceid=17, compaction requested=true 2023-12-03 10:54:57,879 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8b5495b1604bfe1ccf77f0ddde66fab7 in 1272ms, sequenceid=17, compaction requested=true 2023-12-03 10:54:57,879 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:54:57,879 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:54:57,879 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:57,879 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:57,879 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:54:57,879 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:54:58,249 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/fe754da40a8e45f7bee253ee9b44b794 2023-12-03 10:54:58,253 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/dea52f33c07e401fb6278611b4368409 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/dea52f33c07e401fb6278611b4368409 2023-12-03 10:54:58,257 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/dea52f33c07e401fb6278611b4368409, entries=4, sequenceid=17, filesize=5.4 K 2023-12-03 10:54:58,257 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/fe754da40a8e45f7bee253ee9b44b794 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/fe754da40a8e45f7bee253ee9b44b794 2023-12-03 10:54:58,261 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/fe754da40a8e45f7bee253ee9b44b794, entries=2, sequenceid=17, filesize=5.1 K 2023-12-03 10:54:58,261 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 165139cb0d2367959816aa2994261e13 in 1653ms, sequenceid=17, compaction requested=true 2023-12-03 10:54:58,262 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:54:58,262 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-12-03 10:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-12-03 10:54:58,265 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:58,265 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:58,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:58,265 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:58,265 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:58,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:58,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:58,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:58,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:58,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-12-03 10:54:58,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@169ea674[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:58,267 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-12-03 10:54:58,267 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:58,269 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:58,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:58,269 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-12-03 10:54:58,269 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-12-03 10:54:58,269 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:58,269 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,269 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:58,271 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-12-03 10:54:58,271 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:58,271 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,271 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-12-03 10:54:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:58,274 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-12-03 10:54:58,274 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:58,274 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:58,274 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-12-03 10:54:58,274 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:54:58,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-12-03 10:54:58,275 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:58,275 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:58,275 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:58,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:58,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:58,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:54:58,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:58,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:58,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:58,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:58,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:58,276 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:58,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:58,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:58,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:58,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,277 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:58,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:54:58,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:54:58,280 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:58,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:54:58,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-12-03 10:54:58,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-12-03 10:54:58,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:58,280 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:54:58,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:54:58,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:54:58,380 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:54:58,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:54:58,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-12-03 10:54:58,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1701600898391 (current time:1701600898391). 2023-12-03 10:54:58,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-12-03 10:54:58,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] zookeeper.ReadOnlyZKClient(139): Connect 0x3432b82e to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:54:58,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@277cbaf3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:54:58,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:54:58,405 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:54:58,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3432b82e to 127.0.0.1:62442 2023-12-03 10:54:58,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:54:58,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-12-03 10:54:58,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-12-03 10:54:58,415 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot, current working dir path: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp/snaptb-1701600898381 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-12-03 10:54:58,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-12-03 10:54:58,423 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-12-03 10:54:58,424 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1701601498424 2023-12-03 10:54:58,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-12-03 10:54:58,424 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1701600898381 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-12-03 10:54:58,425 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-12-03 10:54:58,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1075): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-12-03 10:54:58,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-12-03 10:54:58,428 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-12-03 10:54:58,428 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1701601498428 2023-12-03 10:54:58,430 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-12-03 10:54:58,430 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-12-03 10:54:58,531 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-12-03 10:54:58,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-12-03 10:54:58,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-12-03 10:54:58,535 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-12-03 10:54:58,736 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-12-03 10:54:58,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-12-03 10:54:58,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-12-03 10:54:58,737 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-12-03 10:54:58,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1701600898381 2023-12-03 10:54:58,837 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1701600898381' 2023-12-03 10:54:58,837 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-12-03 10:54:58,837 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1701600898381' starting 'acquire' 2023-12-03 10:54:58,837 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1701600898381', kicking off acquire phase on members. 2023-12-03 10:54:58,838 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1701600898381 2023-12-03 10:54:58,838 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1701600898381 2023-12-03 10:54:58,839 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-12-03 10:54:58,839 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-12-03 10:54:58,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-12-03 10:54:58,839 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,839 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:54:58,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1701600898381 2023-12-03 10:54:58,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1701600898381 2023-12-03 10:54:58,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-12-03 10:54:58,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1701600898381 2023-12-03 10:54:58,840 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1701600898381 from table testCompactionWithHFileLink type FLUSH 2023-12-03 10:54:58,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1701600898381 2023-12-03 10:54:58,843 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1701600898381' with timeout 300000ms 2023-12-03 10:54:58,843 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-12-03 10:54:58,843 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1701600898381' starting 'acquire' stage 2023-12-03 10:54:58,843 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1701600898381' locally acquired 2023-12-03 10:54:58,843 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (snaptb-1701600898381) in zk 2023-12-03 10:54:58,844 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,844 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1701600898381 2023-12-03 10:54:58,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:58,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-12-03 10:54:58,844 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1701600898381 2023-12-03 10:54:58,844 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1701600898381' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:54:58,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:58,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:58,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701600898381 2023-12-03 10:54:58,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:58,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'snaptb-1701600898381' on coordinator 2023-12-03 10:54:58,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@612052a5[Count = 0] remaining members to acquire global barrier 2023-12-03 10:54:58,846 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1701600898381' starting 'in-barrier' execution. 2023-12-03 10:54:58,846 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1701600898381 2023-12-03 10:54:58,847 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701600898381 2023-12-03 10:54:58,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1701600898381 2023-12-03 10:54:58,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1701600898381 2023-12-03 10:54:58,847 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1701600898381' received 'reached' from coordinator. 2023-12-03 10:54:58,848 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:58,848 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:54:58,848 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:58,848 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-12-03 10:54:58,848 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:58,848 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:58,848 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-12-03 10:54:58,849 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. started... 2023-12-03 10:54:58,849 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. started... 2023-12-03 10:54:58,849 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. started... 2023-12-03 10:54:58,849 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:54:58,849 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:54:58,849 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:54:58,850 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.' region-info for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,850 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.' region-info for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,850 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.' region-info for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,855 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-12-03 10:54:58,855 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-12-03 10:54:58,855 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-12-03 10:54:58,859 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/e43b3fa2b8e5474881d0759f01b6c5d3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/21fd338ec3974795a5b8da570805fdd6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/1b66cacb21f74e3d85e983e84323bf7c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/c2b878ed45eb4fe18d5b8a30ac1b6841] hfiles 2023-12-03 10:54:58,859 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e0d4934c6dbd45169ffa0078c6990601, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/944e31b1d3a0437794d9a87c2d52b596, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/08c8f4ef453f455baf39084fbc2a539a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/dea52f33c07e401fb6278611b4368409] hfiles 2023-12-03 10:54:58,859 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/4dc65ae32dcf44af959362ea68bf3693, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/a30088f6b1f84470b5cfbe8c4a42815c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/5001cc7cdfde4476a5d577904b0bc169, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/c9a58476ea00423db2ca3619d93bd624] hfiles 2023-12-03 10:54:58,859 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e0d4934c6dbd45169ffa0078c6990601 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,859 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/e43b3fa2b8e5474881d0759f01b6c5d3 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,859 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/4dc65ae32dcf44af959362ea68bf3693 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/21fd338ec3974795a5b8da570805fdd6 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/944e31b1d3a0437794d9a87c2d52b596 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/1b66cacb21f74e3d85e983e84323bf7c for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/a30088f6b1f84470b5cfbe8c4a42815c for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/c2b878ed45eb4fe18d5b8a30ac1b6841 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/08c8f4ef453f455baf39084fbc2a539a for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/5001cc7cdfde4476a5d577904b0bc169 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/4530ade4e6bb4a5893f6ffa53f9542c8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2fe25c047e0c45149cb46e91aff149f3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/022680dab498448682466b98407e4ca6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2215d1dbf9914e2480c0efd66c2a9e79] hfiles 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/4530ade4e6bb4a5893f6ffa53f9542c8 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/dea52f33c07e401fb6278611b4368409 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2fe25c047e0c45149cb46e91aff149f3 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/4f668439be874cd7b85324d646f88bcf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/38a7435be03a43f1a3d0d95e3b28cd49, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/7e7d2af92dfd467bb7a9fa912a9d7fd0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/fe754da40a8e45f7bee253ee9b44b794] hfiles 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/022680dab498448682466b98407e4ca6 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/c9a58476ea00423db2ca3619d93bd624 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2215d1dbf9914e2480c0efd66c2a9e79 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/4f668439be874cd7b85324d646f88bcf for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/d529de4a505142ff8bd105432af5436a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/6c6974e9423f4bd9832f83c689cb3791, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/b115aaf2ec834a13a00f46dabf38ebcf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/2cc5a6f8db354cd8a7ae0ac3059a1832] hfiles 2023-12-03 10:54:58,864 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/d529de4a505142ff8bd105432af5436a for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,863 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/38a7435be03a43f1a3d0d95e3b28cd49 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,864 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/6c6974e9423f4bd9832f83c689cb3791 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,864 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/7e7d2af92dfd467bb7a9fa912a9d7fd0 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,864 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/b115aaf2ec834a13a00f46dabf38ebcf for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,864 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/fe754da40a8e45f7bee253ee9b44b794 for snapshot=snaptb-1701600898381 2023-12-03 10:54:58,864 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/2cc5a6f8db354cd8a7ae0ac3059a1832 for snapshot=snaptb-1701600898381 2023-12-03 10:54:59,037 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-12-03 10:54:59,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-12-03 10:54:59,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-12-03 10:54:59,038 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-12-03 10:54:59,277 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. completed. 2023-12-03 10:54:59,277 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:54:59,278 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-12-03 10:54:59,281 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. completed. 2023-12-03 10:54:59,281 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:54:59,281 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-12-03 10:54:59,281 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. completed. 2023-12-03 10:54:59,281 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:54:59,281 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-12-03 10:54:59,281 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-12-03 10:54:59,281 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,281 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1701600898381' locally completed 2023-12-03 10:54:59,281 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1701600898381' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:54:59,288 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,288 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1701600898381' has notified controller of completion 2023-12-03 10:54:59,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:59,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-12-03 10:54:59,288 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:59,289 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1701600898381' completed. 2023-12-03 10:54:59,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:59,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:59,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701600898381 2023-12-03 10:54:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701600898381 2023-12-03 10:54:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1701600898381' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:54:59,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'snaptb-1701600898381', counting down latch. Waiting for 0 more 2023-12-03 10:54:59,291 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1701600898381' execution completed 2023-12-03 10:54:59,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:54:59,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:54:59,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1701600898381 2023-12-03 10:54:59,291 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1701600898381including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-12-03 10:54:59,293 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701600898381 2023-12-03 10:54:59,293 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701600898381 2023-12-03 10:54:59,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1701600898381 2023-12-03 10:54:59,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1701600898381 2023-12-03 10:54:59,293 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-12-03 10:54:59,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:54:59,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-12-03 10:54:59,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1701600898381 2023-12-03 10:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:54:59,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-12-03 10:54:59,294 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-12-03 10:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701600898381 2023-12-03 10:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1701600898381 2023-12-03 10:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:54:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701600898381 2023-12-03 10:54:59,295 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:54:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701600898381 2023-12-03 10:54:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,298 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,298 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701600898381 2023-12-03 10:54:59,298 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701600898381 2023-12-03 10:54:59,298 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701600898381/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:54:59,298 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701600898381 2023-12-03 10:54:59,298 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-12-03 10:54:59,298 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:54:59,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1701600898381 2023-12-03 10:54:59,298 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701600898381 2023-12-03 10:54:59,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-12-03 10:54:59,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-12-03 10:54:59,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1701600898381 because node does not exist (not an error) 2023-12-03 10:54:59,299 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-12-03 10:54:59,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-12-03 10:54:59,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1701600898381 2023-12-03 10:54:59,299 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701600898381 2023-12-03 10:54:59,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-12-03 10:54:59,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-12-03 10:54:59,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-12-03 10:54:59,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312032fb3e8a0e9f24fdcba1bbdd826ea7960, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312037ff4a72cdd19407c9e22ccdbd0f0217c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203d78c7071d96d44368c2354c38d0330ad, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203dc84e0647c2b44d7957e38fc5977dcf6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312032e90e14765544c32aa3c367fafa64834, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312035a81da2ec3204552a8c008e1f373ce9b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312037a6f50af4b3b4f2e99a9393ff2828675, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312039fbb451648694461855b105224707bbe, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023120331a6522ef732428fb47c5cc2fc1cdd65, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312037192e36becbf4d11b19a3d7dc71df0c5, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231203886c17d39a634a4a8d98490294e521ba, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312039a55e318e7bf4043a874a621d150e375] mob files 2023-12-03 10:54:59,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312032fb3e8a0e9f24fdcba1bbdd826ea7960 2023-12-03 10:54:59,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312037ff4a72cdd19407c9e22ccdbd0f0217c 2023-12-03 10:54:59,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203d78c7071d96d44368c2354c38d0330ad 2023-12-03 10:54:59,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203dc84e0647c2b44d7957e38fc5977dcf6 2023-12-03 10:54:59,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312032e90e14765544c32aa3c367fafa64834 2023-12-03 10:54:59,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312035a81da2ec3204552a8c008e1f373ce9b 2023-12-03 10:54:59,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312037a6f50af4b3b4f2e99a9393ff2828675 2023-12-03 10:54:59,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312039fbb451648694461855b105224707bbe 2023-12-03 10:54:59,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023120331a6522ef732428fb47c5cc2fc1cdd65 2023-12-03 10:54:59,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312037192e36becbf4d11b19a3d7dc71df0c5 2023-12-03 10:54:59,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231203886c17d39a634a4a8d98490294e521ba 2023-12-03 10:54:59,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312039a55e318e7bf4043a874a621d150e375 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023120326635d0343a54d5693b17c27ab74a7c8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202312034ace4a2d14a94cceb436febcb8170301, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203968fad6d458240b28c58470c9e8b5fa1, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203da036c48ec8645ff823bc3f24c64e9b2, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023120363ce55068854418f816d39d980e82224, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202312037b4df1edcc8d43e4b93c55da18b24669, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231203d307962ee0fe4328af05e8ef144c7ea5, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231203deebbb38791d49cca29a2d1e22566035, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023120331e7bdd6c5964091a592de5386f911d1, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202312034857c26e327c400eafb094230a7a3bf0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202312038bb541d7ff4448829894e1a78ce0d719, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231203fbe086cd531e44b9a4b1ccf4957fb618] mob files 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023120326635d0343a54d5693b17c27ab74a7c8 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202312034ace4a2d14a94cceb436febcb8170301 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203968fad6d458240b28c58470c9e8b5fa1 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203da036c48ec8645ff823bc3f24c64e9b2 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023120363ce55068854418f816d39d980e82224 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202312037b4df1edcc8d43e4b93c55da18b24669 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231203d307962ee0fe4328af05e8ef144c7ea5 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231203deebbb38791d49cca29a2d1e22566035 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023120331e7bdd6c5964091a592de5386f911d1 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202312034857c26e327c400eafb094230a7a3bf0 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202312038bb541d7ff4448829894e1a78ce0d719 2023-12-03 10:54:59,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231203fbe086cd531e44b9a4b1ccf4957fb618 2023-12-03 10:54:59,538 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-12-03 10:54:59,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-12-03 10:54:59,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-12-03 10:54:59,539 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-12-03 10:54:59,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1701600898381 2023-12-03 10:54:59,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp/snaptb-1701600898381 2023-12-03 10:55:00,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp/snaptb-1701600898381 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/snaptb-1701600898381 2023-12-03 10:55:00,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1701600898381 of table testCompactionWithHFileLink completed 2023-12-03 10:55:00,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp/snaptb-1701600898381 2023-12-03 10:55:00,159 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp/snaptb-1701600898381 2023-12-03 10:55:00,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1701600898381 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1701600898424Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1701600899707 (+1283 ms)Consolidate snapshot: snaptb-1701600898381 at 1701600899707Loading Region manifests for snaptb-1701600898381 at 1701600899707Writing data manifest for snaptb-1701600898381 at 1701600899716 (+9 ms)Verifying snapshot: snaptb-1701600898381 at 1701600900123 (+407 ms)Snapshot snaptb-1701600898381 of table testCompactionWithHFileLink completed at 1701600900159 (+36 ms) 2023-12-03 10:55:00,160 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-12-03 10:55:00,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7350 sec 2023-12-03 10:55:00,539 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-12-03 10:55:00,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-12-03 10:55:00,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-12-03 10:55:00,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:00,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:00,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-12-03 10:55:00,575 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-12-03 10:55:00,575 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:00,575 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-12-03 10:55:00,575 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-12-03 10:55:00,575 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:55:00,575 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:55:00,576 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:00,576 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:00,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:00,577 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:00,577 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:55:00,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:55:00,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:00,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:55:00,578 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-12-03 10:55:00,578 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-12-03 10:55:00,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-12-03 10:55:00,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-12-03 10:55:00,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:00,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-12-03 10:55:00,578 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:00,578 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. started... 2023-12-03 10:55:00,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:00,578 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8b5495b1604bfe1ccf77f0ddde66fab7 2/2 column families, dataSize=138 B heapSize=944 B 2023-12-03 10:55:00,578 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:00,578 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:00,578 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. started... 2023-12-03 10:55:00,578 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:00,578 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. started... 2023-12-03 10:55:00,579 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 165139cb0d2367959816aa2994261e13 2/2 column families, dataSize=138 B heapSize=944 B 2023-12-03 10:55:00,579 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 4132a9cb8c9f3da44edb46b737bab3eb 2/2 column families, dataSize=138 B heapSize=944 B 2023-12-03 10:55:01,405 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/2b9f7e6af6704b5993ddabbb12fce1d4 2023-12-03 10:55:01,405 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/3ad0d93c93544b02b3435d8177a1a11f 2023-12-03 10:55:01,406 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/0a5be901254247f7b61a9151dabd47da 2023-12-03 10:55:01,409 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b9f7e6af6704b5993ddabbb12fce1d4 2023-12-03 10:55:01,410 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ad0d93c93544b02b3435d8177a1a11f 2023-12-03 10:55:01,410 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a5be901254247f7b61a9151dabd47da 2023-12-03 10:55:01,825 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/e9bbf391b844413a90476dd68227aaa0 2023-12-03 10:55:01,829 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9bbf391b844413a90476dd68227aaa0 2023-12-03 10:55:01,830 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/3ad0d93c93544b02b3435d8177a1a11f as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/3ad0d93c93544b02b3435d8177a1a11f 2023-12-03 10:55:01,833 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ad0d93c93544b02b3435d8177a1a11f 2023-12-03 10:55:01,834 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/3ad0d93c93544b02b3435d8177a1a11f, entries=3, sequenceid=24, filesize=5.0 K 2023-12-03 10:55:01,834 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/e9bbf391b844413a90476dd68227aaa0 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/e9bbf391b844413a90476dd68227aaa0 2023-12-03 10:55:01,836 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/75e4f3e5f68b4556aa5f4171b73d6489 2023-12-03 10:55:01,839 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9bbf391b844413a90476dd68227aaa0 2023-12-03 10:55:01,839 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/e9bbf391b844413a90476dd68227aaa0, entries=1, sequenceid=24, filesize=5.0 K 2023-12-03 10:55:01,840 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4132a9cb8c9f3da44edb46b737bab3eb in 1261ms, sequenceid=24, compaction requested=true 2023-12-03 10:55:01,840 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:55:01,840 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75e4f3e5f68b4556aa5f4171b73d6489 2023-12-03 10:55:01,840 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:01,840 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:01,841 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/2b9f7e6af6704b5993ddabbb12fce1d4 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/2b9f7e6af6704b5993ddabbb12fce1d4 2023-12-03 10:55:01,845 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b9f7e6af6704b5993ddabbb12fce1d4 2023-12-03 10:55:01,845 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/2b9f7e6af6704b5993ddabbb12fce1d4, entries=3, sequenceid=24, filesize=5.0 K 2023-12-03 10:55:01,846 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/75e4f3e5f68b4556aa5f4171b73d6489 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/75e4f3e5f68b4556aa5f4171b73d6489 2023-12-03 10:55:01,849 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75e4f3e5f68b4556aa5f4171b73d6489 2023-12-03 10:55:01,850 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/75e4f3e5f68b4556aa5f4171b73d6489, entries=1, sequenceid=24, filesize=5.0 K 2023-12-03 10:55:01,850 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 165139cb0d2367959816aa2994261e13 in 1271ms, sequenceid=24, compaction requested=true 2023-12-03 10:55:01,850 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:55:01,850 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:01,850 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:02,239 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/fcb95f54c7344f339138aea4b64de609 2023-12-03 10:55:02,243 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcb95f54c7344f339138aea4b64de609 2023-12-03 10:55:02,243 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/0a5be901254247f7b61a9151dabd47da as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/0a5be901254247f7b61a9151dabd47da 2023-12-03 10:55:02,247 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a5be901254247f7b61a9151dabd47da 2023-12-03 10:55:02,247 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/0a5be901254247f7b61a9151dabd47da, entries=3, sequenceid=24, filesize=5.0 K 2023-12-03 10:55:02,247 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/fcb95f54c7344f339138aea4b64de609 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/fcb95f54c7344f339138aea4b64de609 2023-12-03 10:55:02,251 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcb95f54c7344f339138aea4b64de609 2023-12-03 10:55:02,251 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/fcb95f54c7344f339138aea4b64de609, entries=1, sequenceid=24, filesize=5.0 K 2023-12-03 10:55:02,252 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8b5495b1604bfe1ccf77f0ddde66fab7 in 1674ms, sequenceid=24, compaction requested=true 2023-12-03 10:55:02,252 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:55:02,252 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:02,252 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:02,252 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:02,252 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,252 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-12-03 10:55:02,252 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-12-03 10:55:02,255 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,255 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:55:02,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:02,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:02,255 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:55:02,255 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:55:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:02,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-12-03 10:55:02,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55dc31c8[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:02,257 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-12-03 10:55:02,257 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:55:02,258 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:55:02,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:55:02,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:55:02,258 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-12-03 10:55:02,258 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,258 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:02,258 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-12-03 10:55:02,258 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-12-03 10:55:02,260 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-12-03 10:55:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:55:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:02,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:55:02,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:02,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-12-03 10:55:02,262 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-12-03 10:55:02,262 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:02,262 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:02,262 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-12-03 10:55:02,262 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:02,264 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:55:02,264 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:55:02,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:55:02,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:55:02,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:55:02,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:02,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:02,264 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:02,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:02,265 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:55:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:55:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:55:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,266 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-12-03 10:55:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,270 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,270 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:02,270 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:55:02,270 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:02,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:02,270 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:02,270 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-12-03 10:55:02,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-12-03 10:55:02,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:02,270 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:02,270 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:55:02,270 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-12-03 10:55:02,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:02,270 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-12-03 10:55:02,270 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:02,271 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:02,371 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:02,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:02,373 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:02,373 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 8b5495b1604bfe1ccf77f0ddde66fab7/family1 is initiating major compaction (all files) 2023-12-03 10:55:02,373 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:02,373 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:02,374 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 8b5495b1604bfe1ccf77f0ddde66fab7/family1 in testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:02,374 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/e43b3fa2b8e5474881d0759f01b6c5d3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/21fd338ec3974795a5b8da570805fdd6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/1b66cacb21f74e3d85e983e84323bf7c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/c2b878ed45eb4fe18d5b8a30ac1b6841, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/0a5be901254247f7b61a9151dabd47da] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp, totalSize=26.7 K 2023-12-03 10:55:02,375 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting e43b3fa2b8e5474881d0759f01b6c5d3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891196 2023-12-03 10:55:02,375 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 21fd338ec3974795a5b8da570805fdd6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892995 2023-12-03 10:55:02,376 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 1b66cacb21f74e3d85e983e84323bf7c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894808 2023-12-03 10:55:02,376 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting c2b878ed45eb4fe18d5b8a30ac1b6841, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896596 2023-12-03 10:55:02,376 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 0a5be901254247f7b61a9151dabd47da, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-12-03 10:55:02,389 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 8b5495b1604bfe1ccf77f0ddde66fab7#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:02,797 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202312034cdda232fc314db98364002f827123f5_del 2023-12-03 10:55:02,798 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312034cdda232fc314db98364002f827123f5_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312034cdda232fc314db98364002f827123f5_del 2023-12-03 10:55:03,281 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:55:03,611 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 710d3056c23d4361860d868ccaeb27f0 2023-12-03 10:55:03,612 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/710d3056c23d4361860d868ccaeb27f0 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/710d3056c23d4361860d868ccaeb27f0 2023-12-03 10:55:03,616 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 710d3056c23d4361860d868ccaeb27f0 2023-12-03 10:55:03,617 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8b5495b1604bfe1ccf77f0ddde66fab7/family1 of 8b5495b1604bfe1ccf77f0ddde66fab7 into 710d3056c23d4361860d868ccaeb27f0(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:03,617 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:55:03,617 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:03,617 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 8b5495b1604bfe1ccf77f0ddde66fab7/family2 is initiating major compaction (all files) 2023-12-03 10:55:03,617 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:03,617 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:03,618 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 8b5495b1604bfe1ccf77f0ddde66fab7/family2 in testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:03,618 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/4530ade4e6bb4a5893f6ffa53f9542c8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2fe25c047e0c45149cb46e91aff149f3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/022680dab498448682466b98407e4ca6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2215d1dbf9914e2480c0efd66c2a9e79, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/fcb95f54c7344f339138aea4b64de609] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp, totalSize=25.4 K 2023-12-03 10:55:03,618 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 4530ade4e6bb4a5893f6ffa53f9542c8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891196 2023-12-03 10:55:03,619 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 2fe25c047e0c45149cb46e91aff149f3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892995 2023-12-03 10:55:03,619 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 022680dab498448682466b98407e4ca6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894808 2023-12-03 10:55:03,619 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 2215d1dbf9914e2480c0efd66c2a9e79, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896596 2023-12-03 10:55:03,620 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting fcb95f54c7344f339138aea4b64de609, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-12-03 10:55:03,630 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 8b5495b1604bfe1ccf77f0ddde66fab7#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:03,637 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231203a35189a80b2343b78f429815e0701047_del 2023-12-03 10:55:03,637 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203a35189a80b2343b78f429815e0701047_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203a35189a80b2343b78f429815e0701047_del 2023-12-03 10:55:03,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/e43b3fa2b8e5474881d0759f01b6c5d3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/21fd338ec3974795a5b8da570805fdd6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/1b66cacb21f74e3d85e983e84323bf7c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/c2b878ed45eb4fe18d5b8a30ac1b6841, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/0a5be901254247f7b61a9151dabd47da] to archive 2023-12-03 10:55:03,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:03,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/e43b3fa2b8e5474881d0759f01b6c5d3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/e43b3fa2b8e5474881d0759f01b6c5d3 2023-12-03 10:55:03,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/21fd338ec3974795a5b8da570805fdd6 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/21fd338ec3974795a5b8da570805fdd6 2023-12-03 10:55:03,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/1b66cacb21f74e3d85e983e84323bf7c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/1b66cacb21f74e3d85e983e84323bf7c 2023-12-03 10:55:03,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/c2b878ed45eb4fe18d5b8a30ac1b6841 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/c2b878ed45eb4fe18d5b8a30ac1b6841 2023-12-03 10:55:03,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/0a5be901254247f7b61a9151dabd47da to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/0a5be901254247f7b61a9151dabd47da 2023-12-03 10:55:04,452 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 481796dce2424aab810d895758287a57 2023-12-03 10:55:04,453 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/481796dce2424aab810d895758287a57 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/481796dce2424aab810d895758287a57 2023-12-03 10:55:04,457 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 481796dce2424aab810d895758287a57 2023-12-03 10:55:04,458 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8b5495b1604bfe1ccf77f0ddde66fab7/family2 of 8b5495b1604bfe1ccf77f0ddde66fab7 into 481796dce2424aab810d895758287a57(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:04,458 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:55:04,458 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:04,459 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 4132a9cb8c9f3da44edb46b737bab3eb/family1 is initiating major compaction (all files) 2023-12-03 10:55:04,459 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:04,459 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:04,459 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 4132a9cb8c9f3da44edb46b737bab3eb/family1 in testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:04,459 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/4dc65ae32dcf44af959362ea68bf3693, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/a30088f6b1f84470b5cfbe8c4a42815c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/5001cc7cdfde4476a5d577904b0bc169, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/c9a58476ea00423db2ca3619d93bd624, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/3ad0d93c93544b02b3435d8177a1a11f] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp, totalSize=26.7 K 2023-12-03 10:55:04,460 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 4dc65ae32dcf44af959362ea68bf3693, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891194 2023-12-03 10:55:04,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/4530ade4e6bb4a5893f6ffa53f9542c8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2fe25c047e0c45149cb46e91aff149f3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/022680dab498448682466b98407e4ca6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2215d1dbf9914e2480c0efd66c2a9e79, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/fcb95f54c7344f339138aea4b64de609] to archive 2023-12-03 10:55:04,460 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting a30088f6b1f84470b5cfbe8c4a42815c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892994 2023-12-03 10:55:04,460 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 5001cc7cdfde4476a5d577904b0bc169, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894807 2023-12-03 10:55:04,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:04,461 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting c9a58476ea00423db2ca3619d93bd624, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896595 2023-12-03 10:55:04,461 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 3ad0d93c93544b02b3435d8177a1a11f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-12-03 10:55:04,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/4530ade4e6bb4a5893f6ffa53f9542c8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/4530ade4e6bb4a5893f6ffa53f9542c8 2023-12-03 10:55:04,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2fe25c047e0c45149cb46e91aff149f3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2fe25c047e0c45149cb46e91aff149f3 2023-12-03 10:55:04,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/022680dab498448682466b98407e4ca6 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/022680dab498448682466b98407e4ca6 2023-12-03 10:55:04,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2215d1dbf9914e2480c0efd66c2a9e79 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/2215d1dbf9914e2480c0efd66c2a9e79 2023-12-03 10:55:04,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/fcb95f54c7344f339138aea4b64de609 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/fcb95f54c7344f339138aea4b64de609 2023-12-03 10:55:04,473 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 4132a9cb8c9f3da44edb46b737bab3eb#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:04,886 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202312032cad8370e5514be28cb6f526eaf9212f_del 2023-12-03 10:55:04,887 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312032cad8370e5514be28cb6f526eaf9212f_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312032cad8370e5514be28cb6f526eaf9212f_del 2023-12-03 10:55:05,700 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dbc4a9efc2c40e2ace9deaa33432168 2023-12-03 10:55:05,701 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/2dbc4a9efc2c40e2ace9deaa33432168 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/2dbc4a9efc2c40e2ace9deaa33432168 2023-12-03 10:55:05,705 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dbc4a9efc2c40e2ace9deaa33432168 2023-12-03 10:55:05,706 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4132a9cb8c9f3da44edb46b737bab3eb/family1 of 4132a9cb8c9f3da44edb46b737bab3eb into 2dbc4a9efc2c40e2ace9deaa33432168(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:05,706 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:55:05,706 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:05,706 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 4132a9cb8c9f3da44edb46b737bab3eb/family2 is initiating major compaction (all files) 2023-12-03 10:55:05,706 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:05,706 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:05,706 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 4132a9cb8c9f3da44edb46b737bab3eb/family2 in testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:05,706 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/d529de4a505142ff8bd105432af5436a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/6c6974e9423f4bd9832f83c689cb3791, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/b115aaf2ec834a13a00f46dabf38ebcf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/2cc5a6f8db354cd8a7ae0ac3059a1832, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/e9bbf391b844413a90476dd68227aaa0] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp, totalSize=25.4 K 2023-12-03 10:55:05,707 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting d529de4a505142ff8bd105432af5436a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891194 2023-12-03 10:55:05,707 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 6c6974e9423f4bd9832f83c689cb3791, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892994 2023-12-03 10:55:05,707 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting b115aaf2ec834a13a00f46dabf38ebcf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894807 2023-12-03 10:55:05,708 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 2cc5a6f8db354cd8a7ae0ac3059a1832, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896595 2023-12-03 10:55:05,708 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting e9bbf391b844413a90476dd68227aaa0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-12-03 10:55:05,719 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 4132a9cb8c9f3da44edb46b737bab3eb#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:05,733 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231203c97cb58fec064b2ba1466fcac5fcfcce_del 2023-12-03 10:55:05,733 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203c97cb58fec064b2ba1466fcac5fcfcce_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231203c97cb58fec064b2ba1466fcac5fcfcce_del 2023-12-03 10:55:05,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/4dc65ae32dcf44af959362ea68bf3693, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/a30088f6b1f84470b5cfbe8c4a42815c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/5001cc7cdfde4476a5d577904b0bc169, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/c9a58476ea00423db2ca3619d93bd624, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/3ad0d93c93544b02b3435d8177a1a11f] to archive 2023-12-03 10:55:05,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:05,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/4dc65ae32dcf44af959362ea68bf3693 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/4dc65ae32dcf44af959362ea68bf3693 2023-12-03 10:55:05,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/a30088f6b1f84470b5cfbe8c4a42815c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/a30088f6b1f84470b5cfbe8c4a42815c 2023-12-03 10:55:05,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/5001cc7cdfde4476a5d577904b0bc169 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/5001cc7cdfde4476a5d577904b0bc169 2023-12-03 10:55:05,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/c9a58476ea00423db2ca3619d93bd624 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/c9a58476ea00423db2ca3619d93bd624 2023-12-03 10:55:05,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/3ad0d93c93544b02b3435d8177a1a11f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/3ad0d93c93544b02b3435d8177a1a11f 2023-12-03 10:55:06,147 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3456d29aa954445d92cbe5561de4bd16 2023-12-03 10:55:06,148 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/3456d29aa954445d92cbe5561de4bd16 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/3456d29aa954445d92cbe5561de4bd16 2023-12-03 10:55:06,152 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3456d29aa954445d92cbe5561de4bd16 2023-12-03 10:55:06,153 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4132a9cb8c9f3da44edb46b737bab3eb/family2 of 4132a9cb8c9f3da44edb46b737bab3eb into 3456d29aa954445d92cbe5561de4bd16(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:06,153 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:55:06,153 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:06,153 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 165139cb0d2367959816aa2994261e13/family1 is initiating major compaction (all files) 2023-12-03 10:55:06,153 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:06,153 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:06,154 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 165139cb0d2367959816aa2994261e13/family1 in testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:06,154 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e0d4934c6dbd45169ffa0078c6990601, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/944e31b1d3a0437794d9a87c2d52b596, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/08c8f4ef453f455baf39084fbc2a539a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/dea52f33c07e401fb6278611b4368409, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/2b9f7e6af6704b5993ddabbb12fce1d4] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp, totalSize=26.7 K 2023-12-03 10:55:06,154 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting e0d4934c6dbd45169ffa0078c6990601, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891197 2023-12-03 10:55:06,155 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 944e31b1d3a0437794d9a87c2d52b596, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892995 2023-12-03 10:55:06,155 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 08c8f4ef453f455baf39084fbc2a539a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894808 2023-12-03 10:55:06,155 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting dea52f33c07e401fb6278611b4368409, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896596 2023-12-03 10:55:06,156 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 2b9f7e6af6704b5993ddabbb12fce1d4, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-12-03 10:55:06,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/d529de4a505142ff8bd105432af5436a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/6c6974e9423f4bd9832f83c689cb3791, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/b115aaf2ec834a13a00f46dabf38ebcf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/2cc5a6f8db354cd8a7ae0ac3059a1832, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/e9bbf391b844413a90476dd68227aaa0] to archive 2023-12-03 10:55:06,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:06,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/d529de4a505142ff8bd105432af5436a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/d529de4a505142ff8bd105432af5436a 2023-12-03 10:55:06,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/6c6974e9423f4bd9832f83c689cb3791 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/6c6974e9423f4bd9832f83c689cb3791 2023-12-03 10:55:06,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/b115aaf2ec834a13a00f46dabf38ebcf to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/b115aaf2ec834a13a00f46dabf38ebcf 2023-12-03 10:55:06,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/2cc5a6f8db354cd8a7ae0ac3059a1832 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/2cc5a6f8db354cd8a7ae0ac3059a1832 2023-12-03 10:55:06,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/e9bbf391b844413a90476dd68227aaa0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/e9bbf391b844413a90476dd68227aaa0 2023-12-03 10:55:06,167 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 165139cb0d2367959816aa2994261e13#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:06,576 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231203adff2ef04a2e4dd3959b4bdf8b32187d_del 2023-12-03 10:55:06,576 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203adff2ef04a2e4dd3959b4bdf8b32187d_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231203adff2ef04a2e4dd3959b4bdf8b32187d_del 2023-12-03 10:55:07,391 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7cd6ebdd5ccf48d59d7ca3c93da5d2b1 2023-12-03 10:55:07,392 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/7cd6ebdd5ccf48d59d7ca3c93da5d2b1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/7cd6ebdd5ccf48d59d7ca3c93da5d2b1 2023-12-03 10:55:07,396 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7cd6ebdd5ccf48d59d7ca3c93da5d2b1 2023-12-03 10:55:07,397 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 165139cb0d2367959816aa2994261e13/family1 of 165139cb0d2367959816aa2994261e13 into 7cd6ebdd5ccf48d59d7ca3c93da5d2b1(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:07,397 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:55:07,397 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:07,397 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 165139cb0d2367959816aa2994261e13/family2 is initiating major compaction (all files) 2023-12-03 10:55:07,397 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:07,397 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:07,398 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 165139cb0d2367959816aa2994261e13/family2 in testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:07,398 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/4f668439be874cd7b85324d646f88bcf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/38a7435be03a43f1a3d0d95e3b28cd49, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/7e7d2af92dfd467bb7a9fa912a9d7fd0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/fe754da40a8e45f7bee253ee9b44b794, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/75e4f3e5f68b4556aa5f4171b73d6489] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp, totalSize=25.4 K 2023-12-03 10:55:07,398 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 4f668439be874cd7b85324d646f88bcf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891197 2023-12-03 10:55:07,398 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 38a7435be03a43f1a3d0d95e3b28cd49, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892995 2023-12-03 10:55:07,399 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 7e7d2af92dfd467bb7a9fa912a9d7fd0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894808 2023-12-03 10:55:07,399 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting fe754da40a8e45f7bee253ee9b44b794, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896596 2023-12-03 10:55:07,399 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 75e4f3e5f68b4556aa5f4171b73d6489, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-12-03 10:55:07,411 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 165139cb0d2367959816aa2994261e13#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:07,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e0d4934c6dbd45169ffa0078c6990601, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/944e31b1d3a0437794d9a87c2d52b596, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/08c8f4ef453f455baf39084fbc2a539a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/dea52f33c07e401fb6278611b4368409, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/2b9f7e6af6704b5993ddabbb12fce1d4] to archive 2023-12-03 10:55:07,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:07,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e0d4934c6dbd45169ffa0078c6990601 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e0d4934c6dbd45169ffa0078c6990601 2023-12-03 10:55:07,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/944e31b1d3a0437794d9a87c2d52b596 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/944e31b1d3a0437794d9a87c2d52b596 2023-12-03 10:55:07,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/08c8f4ef453f455baf39084fbc2a539a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/08c8f4ef453f455baf39084fbc2a539a 2023-12-03 10:55:07,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/dea52f33c07e401fb6278611b4368409 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/dea52f33c07e401fb6278611b4368409 2023-12-03 10:55:07,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/2b9f7e6af6704b5993ddabbb12fce1d4 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/2b9f7e6af6704b5993ddabbb12fce1d4 2023-12-03 10:55:07,821 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023120358e1cc0aeecb4db2ba0b7eb2f9d5520e_del 2023-12-03 10:55:07,821 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023120358e1cc0aeecb4db2ba0b7eb2f9d5520e_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023120358e1cc0aeecb4db2ba0b7eb2f9d5520e_del 2023-12-03 10:55:08,637 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf1f5245a9ab4c909ea7ead288918e40 2023-12-03 10:55:08,638 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/cf1f5245a9ab4c909ea7ead288918e40 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/cf1f5245a9ab4c909ea7ead288918e40 2023-12-03 10:55:08,641 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf1f5245a9ab4c909ea7ead288918e40 2023-12-03 10:55:08,642 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 165139cb0d2367959816aa2994261e13/family2 of 165139cb0d2367959816aa2994261e13 into cf1f5245a9ab4c909ea7ead288918e40(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:08,643 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:55:08,648 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:08,652 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:08,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/4f668439be874cd7b85324d646f88bcf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/38a7435be03a43f1a3d0d95e3b28cd49, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/7e7d2af92dfd467bb7a9fa912a9d7fd0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/fe754da40a8e45f7bee253ee9b44b794, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/75e4f3e5f68b4556aa5f4171b73d6489] to archive 2023-12-03 10:55:08,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:08,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/4f668439be874cd7b85324d646f88bcf to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/4f668439be874cd7b85324d646f88bcf 2023-12-03 10:55:08,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/38a7435be03a43f1a3d0d95e3b28cd49 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/38a7435be03a43f1a3d0d95e3b28cd49 2023-12-03 10:55:08,657 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:08,658 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:08,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/7e7d2af92dfd467bb7a9fa912a9d7fd0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/7e7d2af92dfd467bb7a9fa912a9d7fd0 2023-12-03 10:55:08,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/fe754da40a8e45f7bee253ee9b44b794 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/fe754da40a8e45f7bee253ee9b44b794 2023-12-03 10:55:08,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/75e4f3e5f68b4556aa5f4171b73d6489 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/75e4f3e5f68b4556aa5f4171b73d6489 2023-12-03 10:55:08,669 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-12-03 10:55:08,704 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-12-03 10:55:08,707 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202312032cad8370e5514be28cb6f526eaf9212f_del 2023-12-03 10:55:08,710 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202312034cdda232fc314db98364002f827123f5_del 2023-12-03 10:55:08,713 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231203adff2ef04a2e4dd3959b4bdf8b32187d_del 2023-12-03 10:55:08,713 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:08,714 DEBUG [Listener at localhost/33475] zookeeper.ReadOnlyZKClient(139): Connect 0x4a14a253 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:55:08,721 DEBUG [Listener at localhost/33475] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@452574f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:55:08,721 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:08,721 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:08,723 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:09,205 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312035ba2d4a4c7f444f7b6e6f0cec5f05587 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312035ba2d4a4c7f444f7b6e6f0cec5f05587 2023-12-03 10:55:09,206 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:09,221 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:55:09,224 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:55:09,230 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:55:09,232 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:55:09,239 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231203/family1/74ca253bb6db410fb5c184f139a4fd00 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-12-03 10:55:09,240 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231203/family1/74ca253bb6db410fb5c184f139a4fd00}] 2023-12-03 10:55:09,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231203/family1/74ca253bb6db410fb5c184f139a4fd00 for inclusion in 165139cb0d2367959816aa2994261e13/family1 2023-12-03 10:55:09,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-12-03 10:55:09,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first=2 last= 2023-12-03 10:55:09,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:55:09,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231203/family1/74ca253bb6db410fb5c184f139a4fd00 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__2vosdnj9a1147fopm9s2hks5bfatv6p09eno6el0hmri710966bcqi6eno9d8ufn/family1/74ca253bb6db410fb5c184f139a4fd00 2023-12-03 10:55:09,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__2vosdnj9a1147fopm9s2hks5bfatv6p09eno6el0hmri710966bcqi6eno9d8ufn/family1/74ca253bb6db410fb5c184f139a4fd00 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e7bd6d082e92415daac620fd2806e1d8_SeqId_29_ 2023-12-03 10:55:09,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__2vosdnj9a1147fopm9s2hks5bfatv6p09eno6el0hmri710966bcqi6eno9d8ufn/family1/74ca253bb6db410fb5c184f139a4fd00 into 165139cb0d2367959816aa2994261e13/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e7bd6d082e92415daac620fd2806e1d8_SeqId_29_ - updating store file list. 2023-12-03 10:55:09,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e7bd6d082e92415daac620fd2806e1d8_SeqId_29_ into 165139cb0d2367959816aa2994261e13/family1 2023-12-03 10:55:09,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__2vosdnj9a1147fopm9s2hks5bfatv6p09eno6el0hmri710966bcqi6eno9d8ufn/family1/74ca253bb6db410fb5c184f139a4fd00 into 165139cb0d2367959816aa2994261e13/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e7bd6d082e92415daac620fd2806e1d8_SeqId_29_) 2023-12-03 10:55:09,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__2vosdnj9a1147fopm9s2hks5bfatv6p09eno6el0hmri710966bcqi6eno9d8ufn/family1/74ca253bb6db410fb5c184f139a4fd00 2023-12-03 10:55:09,253 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:09,254 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:09,255 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312032e90e14765544c32aa3c367fafa64834 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312032e90e14765544c32aa3c367fafa64834 2023-12-03 10:55:09,256 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312035a81da2ec3204552a8c008e1f373ce9b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312035a81da2ec3204552a8c008e1f373ce9b 2023-12-03 10:55:09,257 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312037a6f50af4b3b4f2e99a9393ff2828675 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312037a6f50af4b3b4f2e99a9393ff2828675 2023-12-03 10:55:09,258 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312039fbb451648694461855b105224707bbe to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312039fbb451648694461855b105224707bbe 2023-12-03 10:55:09,258 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-12-03 10:55:09,258 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231203' 2023-12-03 10:55:09,258 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:09,599 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203cc6a26a77f754612853e2d90a6752460 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203cc6a26a77f754612853e2d90a6752460 2023-12-03 10:55:09,599 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:09,617 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312037d7b211fd576475bb09e730af34c8b19 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312037d7b211fd576475bb09e730af34c8b19 2023-12-03 10:55:09,618 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:09,624 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231203/family1/ac4ab5b7643442dea24f354684488d6c first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-12-03 10:55:09,625 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231203/family1/ac4ab5b7643442dea24f354684488d6c}] 2023-12-03 10:55:09,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231203/family1/ac4ab5b7643442dea24f354684488d6c for inclusion in 8b5495b1604bfe1ccf77f0ddde66fab7/family1 2023-12-03 10:55:09,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-12-03 10:55:09,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first=1 last=2 2023-12-03 10:55:09,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:55:09,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231203/family1/ac4ab5b7643442dea24f354684488d6c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__49k8plfaok6ukv5krmmr6jdcn54aropjgo5h2hvsk103gacv7tsf4k44tg3a08jf/family1/ac4ab5b7643442dea24f354684488d6c 2023-12-03 10:55:09,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__49k8plfaok6ukv5krmmr6jdcn54aropjgo5h2hvsk103gacv7tsf4k44tg3a08jf/family1/ac4ab5b7643442dea24f354684488d6c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/479d74da970a4f10acd9371a92b3baba_SeqId_29_ 2023-12-03 10:55:09,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__49k8plfaok6ukv5krmmr6jdcn54aropjgo5h2hvsk103gacv7tsf4k44tg3a08jf/family1/ac4ab5b7643442dea24f354684488d6c into 8b5495b1604bfe1ccf77f0ddde66fab7/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/479d74da970a4f10acd9371a92b3baba_SeqId_29_ - updating store file list. 2023-12-03 10:55:09,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/479d74da970a4f10acd9371a92b3baba_SeqId_29_ into 8b5495b1604bfe1ccf77f0ddde66fab7/family1 2023-12-03 10:55:09,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__49k8plfaok6ukv5krmmr6jdcn54aropjgo5h2hvsk103gacv7tsf4k44tg3a08jf/family1/ac4ab5b7643442dea24f354684488d6c into 8b5495b1604bfe1ccf77f0ddde66fab7/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/479d74da970a4f10acd9371a92b3baba_SeqId_29_) 2023-12-03 10:55:09,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__49k8plfaok6ukv5krmmr6jdcn54aropjgo5h2hvsk103gacv7tsf4k44tg3a08jf/family1/ac4ab5b7643442dea24f354684488d6c 2023-12-03 10:55:09,642 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:09,643 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:09,646 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312032fb3e8a0e9f24fdcba1bbdd826ea7960 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312032fb3e8a0e9f24fdcba1bbdd826ea7960 2023-12-03 10:55:09,647 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312037ff4a72cdd19407c9e22ccdbd0f0217c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312037ff4a72cdd19407c9e22ccdbd0f0217c 2023-12-03 10:55:09,648 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231203/family1/9e82b775776d441583e6bf5b820cc8f3 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-12-03 10:55:09,649 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231203/family1/9e82b775776d441583e6bf5b820cc8f3}] 2023-12-03 10:55:09,649 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203d78c7071d96d44368c2354c38d0330ad to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203d78c7071d96d44368c2354c38d0330ad 2023-12-03 10:55:09,652 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203dc84e0647c2b44d7957e38fc5977dcf6 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203dc84e0647c2b44d7957e38fc5977dcf6 2023-12-03 10:55:09,652 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-12-03 10:55:09,652 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231203' 2023-12-03 10:55:09,652 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:09,652 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231203/family1/9e82b775776d441583e6bf5b820cc8f3 for inclusion in 4132a9cb8c9f3da44edb46b737bab3eb/family1 2023-12-03 10:55:09,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-12-03 10:55:09,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last=1 2023-12-03 10:55:09,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:55:09,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231203/family1/9e82b775776d441583e6bf5b820cc8f3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__oi415v4mv274uku7g4lh1llcsqf9n1afhg2nuegtcdrr11id46nrui8grrbbh2c5/family1/9e82b775776d441583e6bf5b820cc8f3 2023-12-03 10:55:09,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__oi415v4mv274uku7g4lh1llcsqf9n1afhg2nuegtcdrr11id46nrui8grrbbh2c5/family1/9e82b775776d441583e6bf5b820cc8f3 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/1ebe1d6580914ff5b5a4417acaadb086_SeqId_29_ 2023-12-03 10:55:09,659 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__oi415v4mv274uku7g4lh1llcsqf9n1afhg2nuegtcdrr11id46nrui8grrbbh2c5/family1/9e82b775776d441583e6bf5b820cc8f3 into 4132a9cb8c9f3da44edb46b737bab3eb/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/1ebe1d6580914ff5b5a4417acaadb086_SeqId_29_ - updating store file list. 2023-12-03 10:55:09,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/1ebe1d6580914ff5b5a4417acaadb086_SeqId_29_ into 4132a9cb8c9f3da44edb46b737bab3eb/family1 2023-12-03 10:55:09,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__oi415v4mv274uku7g4lh1llcsqf9n1afhg2nuegtcdrr11id46nrui8grrbbh2c5/family1/9e82b775776d441583e6bf5b820cc8f3 into 4132a9cb8c9f3da44edb46b737bab3eb/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/1ebe1d6580914ff5b5a4417acaadb086_SeqId_29_) 2023-12-03 10:55:09,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__oi415v4mv274uku7g4lh1llcsqf9n1afhg2nuegtcdrr11id46nrui8grrbbh2c5/family1/9e82b775776d441583e6bf5b820cc8f3 2023-12-03 10:55:09,664 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:09,665 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:09,667 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023120331a6522ef732428fb47c5cc2fc1cdd65 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023120331a6522ef732428fb47c5cc2fc1cdd65 2023-12-03 10:55:09,668 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312037192e36becbf4d11b19a3d7dc71df0c5 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312037192e36becbf4d11b19a3d7dc71df0c5 2023-12-03 10:55:09,669 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231203886c17d39a634a4a8d98490294e521ba to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231203886c17d39a634a4a8d98490294e521ba 2023-12-03 10:55:09,670 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312039a55e318e7bf4043a874a621d150e375 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312039a55e318e7bf4043a874a621d150e375 2023-12-03 10:55:09,670 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-12-03 10:55:09,670 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231203' 2023-12-03 10:55:09,670 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:09,671 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:09,671 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:09,671 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312032cad8370e5514be28cb6f526eaf9212f_del] 2023-12-03 10:55:09,671 DEBUG [Listener at localhost/33475] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:09,673 DEBUG [Listener at localhost/33475] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312032cad8370e5514be28cb6f526eaf9212f_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312032cad8370e5514be28cb6f526eaf9212f_del 2023-12-03 10:55:09,673 INFO [Listener at localhost/33475] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-12-03 10:55:09,673 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312034cdda232fc314db98364002f827123f5_del] 2023-12-03 10:55:09,673 DEBUG [Listener at localhost/33475] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:09,674 DEBUG [Listener at localhost/33475] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312034cdda232fc314db98364002f827123f5_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312034cdda232fc314db98364002f827123f5_del 2023-12-03 10:55:09,675 INFO [Listener at localhost/33475] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-12-03 10:55:09,675 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231203adff2ef04a2e4dd3959b4bdf8b32187d_del] 2023-12-03 10:55:09,675 DEBUG [Listener at localhost/33475] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:09,676 DEBUG [Listener at localhost/33475] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231203adff2ef04a2e4dd3959b4bdf8b32187d_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231203adff2ef04a2e4dd3959b4bdf8b32187d_del 2023-12-03 10:55:09,676 INFO [Listener at localhost/33475] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-12-03 10:55:09,679 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:09,682 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:09,686 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:09,686 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:09,692 INFO [Listener at localhost/33475] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-12-03 10:55:09,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-12-03 10:55:09,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-12-03 10:55:09,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-12-03 10:55:09,696 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600909696"}]},"ts":"1701600909696"} 2023-12-03 10:55:09,698 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-12-03 10:55:09,700 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-12-03 10:55:09,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, UNASSIGN}] 2023-12-03 10:55:09,701 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, UNASSIGN 2023-12-03 10:55:09,701 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, UNASSIGN 2023-12-03 10:55:09,701 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, UNASSIGN 2023-12-03 10:55:09,702 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=8b5495b1604bfe1ccf77f0ddde66fab7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:09,702 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=165139cb0d2367959816aa2994261e13, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:09,702 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=4132a9cb8c9f3da44edb46b737bab3eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:09,702 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600909702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600909702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600909702"}]},"ts":"1701600909702"} 2023-12-03 10:55:09,702 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600909702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600909702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600909702"}]},"ts":"1701600909702"} 2023-12-03 10:55:09,702 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600909702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600909702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600909702"}]},"ts":"1701600909702"} 2023-12-03 10:55:09,703 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure 165139cb0d2367959816aa2994261e13, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:09,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure 8b5495b1604bfe1ccf77f0ddde66fab7, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:09,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 4132a9cb8c9f3da44edb46b737bab3eb, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:09,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-12-03 10:55:09,855 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:09,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 165139cb0d2367959816aa2994261e13 2023-12-03 10:55:09,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 165139cb0d2367959816aa2994261e13, disabling compactions & flushes 2023-12-03 10:55:09,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:09,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:09,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. after waiting 0 ms 2023-12-03 10:55:09,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:09,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-12-03 10:55:09,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:09,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:55:09,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 165139cb0d2367959816aa2994261e13 2023-12-03 10:55:09,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:09,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8b5495b1604bfe1ccf77f0ddde66fab7, disabling compactions & flushes 2023-12-03 10:55:09,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:09,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:09,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. after waiting 0 ms 2023-12-03 10:55:09,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:09,863 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=165139cb0d2367959816aa2994261e13, regionState=CLOSED 2023-12-03 10:55:09,863 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600909863"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600909863"}]},"ts":"1701600909863"} 2023-12-03 10:55:09,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=92, resume processing ppid=91 2023-12-03 10:55:09,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure 165139cb0d2367959816aa2994261e13, server=jenkins-hbase4.apache.org,44259,1701600798821 in 161 msec 2023-12-03 10:55:09,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-12-03 10:55:09,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, UNASSIGN in 166 msec 2023-12-03 10:55:09,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:09,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:55:09,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:09,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:09,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4132a9cb8c9f3da44edb46b737bab3eb, disabling compactions & flushes 2023-12-03 10:55:09,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:09,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:09,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. after waiting 0 ms 2023-12-03 10:55:09,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:09,869 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=8b5495b1604bfe1ccf77f0ddde66fab7, regionState=CLOSED 2023-12-03 10:55:09,869 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600909869"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600909869"}]},"ts":"1701600909869"} 2023-12-03 10:55:09,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=93, resume processing ppid=90 2023-12-03 10:55:09,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure 8b5495b1604bfe1ccf77f0ddde66fab7, server=jenkins-hbase4.apache.org,44259,1701600798821 in 166 msec 2023-12-03 10:55:09,872 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, UNASSIGN in 171 msec 2023-12-03 10:55:09,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-12-03 10:55:09,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:09,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:55:09,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:09,876 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=4132a9cb8c9f3da44edb46b737bab3eb, regionState=CLOSED 2023-12-03 10:55:09,876 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600909876"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600909876"}]},"ts":"1701600909876"} 2023-12-03 10:55:09,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=94, resume processing ppid=89 2023-12-03 10:55:09,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 4132a9cb8c9f3da44edb46b737bab3eb, server=jenkins-hbase4.apache.org,44259,1701600798821 in 173 msec 2023-12-03 10:55:09,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=89, resume processing ppid=88 2023-12-03 10:55:09,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, UNASSIGN in 178 msec 2023-12-03 10:55:09,879 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600909879"}]},"ts":"1701600909879"} 2023-12-03 10:55:09,880 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-12-03 10:55:09,882 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-12-03 10:55:09,883 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 190 msec 2023-12-03 10:55:09,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-12-03 10:55:09,998 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-12-03 10:55:10,009 INFO [Listener at localhost/33475] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1701600898381-1701600910009 2023-12-03 10:55:10,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-12-03 10:55:10,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1701600910009 (current time:1701600910009). 2023-12-03 10:55:10,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-12-03 10:55:10,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] zookeeper.ReadOnlyZKClient(139): Connect 0x25d42b21 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:55:10,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@219f523f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:55:10,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:55:10,018 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:55:10,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25d42b21 to 127.0.0.1:62442 2023-12-03 10:55:10,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:55:10,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-12-03 10:55:10,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-12-03 10:55:10,022 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot, current working dir path: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701600898381-1701600910009 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-12-03 10:55:10,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-12-03 10:55:10,024 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-12-03 10:55:10,025 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1701601510025 2023-12-03 10:55:10,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-12-03 10:55:10,025 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1701600898381-1701600910009 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-12-03 10:55:10,025 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:10,025 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-12-03 10:55:10,125 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-12-03 10:55:10,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-12-03 10:55:10,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-12-03 10:55:10,127 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-12-03 10:55:10,327 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-12-03 10:55:10,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-12-03 10:55:10,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-12-03 10:55:10,328 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-12-03 10:55:10,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-12-03 10:55:10,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-12-03 10:55:10,433 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-12-03 10:55:10,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-12-03 10:55:10,433 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-12-03 10:55:10,433 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-12-03 10:55:10,433 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-12-03 10:55:10,434 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-12-03 10:55:10,434 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-12-03 10:55:10,436 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/479d74da970a4f10acd9371a92b3baba_SeqId_29_, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/710d3056c23d4361860d868ccaeb27f0] hfiles 2023-12-03 10:55:10,436 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/1ebe1d6580914ff5b5a4417acaadb086_SeqId_29_, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/2dbc4a9efc2c40e2ace9deaa33432168] hfiles 2023-12-03 10:55:10,436 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/479d74da970a4f10acd9371a92b3baba_SeqId_29_ 2023-12-03 10:55:10,436 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/1ebe1d6580914ff5b5a4417acaadb086_SeqId_29_ 2023-12-03 10:55:10,436 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/710d3056c23d4361860d868ccaeb27f0 2023-12-03 10:55:10,436 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/2dbc4a9efc2c40e2ace9deaa33432168 2023-12-03 10:55:10,436 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/7cd6ebdd5ccf48d59d7ca3c93da5d2b1, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e7bd6d082e92415daac620fd2806e1d8_SeqId_29_] hfiles 2023-12-03 10:55:10,436 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/7cd6ebdd5ccf48d59d7ca3c93da5d2b1 2023-12-03 10:55:10,436 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e7bd6d082e92415daac620fd2806e1d8_SeqId_29_ 2023-12-03 10:55:10,437 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203cc6a26a77f754612853e2d90a6752460, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312035ba2d4a4c7f444f7b6e6f0cec5f05587, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312037d7b211fd576475bb09e730af34c8b19] hfiles 2023-12-03 10:55:10,437 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203cc6a26a77f754612853e2d90a6752460 2023-12-03 10:55:10,437 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312035ba2d4a4c7f444f7b6e6f0cec5f05587 2023-12-03 10:55:10,437 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312037d7b211fd576475bb09e730af34c8b19 2023-12-03 10:55:10,437 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/3456d29aa954445d92cbe5561de4bd16] hfiles 2023-12-03 10:55:10,437 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/3456d29aa954445d92cbe5561de4bd16 2023-12-03 10:55:10,437 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/cf1f5245a9ab4c909ea7ead288918e40] hfiles 2023-12-03 10:55:10,437 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/cf1f5245a9ab4c909ea7ead288918e40 2023-12-03 10:55:10,437 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/481796dce2424aab810d895758287a57] hfiles 2023-12-03 10:55:10,437 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/481796dce2424aab810d895758287a57 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023120326635d0343a54d5693b17c27ab74a7c8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202312034ace4a2d14a94cceb436febcb8170301, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203968fad6d458240b28c58470c9e8b5fa1, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203a35189a80b2343b78f429815e0701047_del, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203da036c48ec8645ff823bc3f24c64e9b2, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023120358e1cc0aeecb4db2ba0b7eb2f9d5520e_del, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023120363ce55068854418f816d39d980e82224, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202312037b4df1edcc8d43e4b93c55da18b24669, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231203d307962ee0fe4328af05e8ef144c7ea5, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231203deebbb38791d49cca29a2d1e22566035, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023120331e7bdd6c5964091a592de5386f911d1, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202312034857c26e327c400eafb094230a7a3bf0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202312038bb541d7ff4448829894e1a78ce0d719, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231203c97cb58fec064b2ba1466fcac5fcfcce_del, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231203fbe086cd531e44b9a4b1ccf4957fb618] hfiles 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023120326635d0343a54d5693b17c27ab74a7c8 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202312034ace4a2d14a94cceb436febcb8170301 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203968fad6d458240b28c58470c9e8b5fa1 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203a35189a80b2343b78f429815e0701047_del 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203da036c48ec8645ff823bc3f24c64e9b2 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023120358e1cc0aeecb4db2ba0b7eb2f9d5520e_del 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023120363ce55068854418f816d39d980e82224 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202312037b4df1edcc8d43e4b93c55da18b24669 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231203d307962ee0fe4328af05e8ef144c7ea5 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231203deebbb38791d49cca29a2d1e22566035 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023120331e7bdd6c5964091a592de5386f911d1 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202312034857c26e327c400eafb094230a7a3bf0 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202312038bb541d7ff4448829894e1a78ce0d719 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231203c97cb58fec064b2ba1466fcac5fcfcce_del 2023-12-03 10:55:10,446 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231203fbe086cd531e44b9a4b1ccf4957fb618 2023-12-03 10:55:10,628 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-12-03 10:55:10,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-12-03 10:55:10,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-12-03 10:55:10,629 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-12-03 10:55:10,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-12-03 10:55:10,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1701600898381-1701600910009 2023-12-03 10:55:10,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701600898381-1701600910009 2023-12-03 10:55:11,130 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-12-03 10:55:11,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-12-03 10:55:11,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-12-03 10:55:11,131 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-12-03 10:55:11,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701600898381-1701600910009 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/hbase-failsafe-snaptb-1701600898381-1701600910009 2023-12-03 10:55:11,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1701600898381-1701600910009 of table testCompactionWithHFileLink completed 2023-12-03 10:55:11,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701600898381-1701600910009 2023-12-03 10:55:11,276 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701600898381-1701600910009 2023-12-03 10:55:11,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1701600898381-1701600910009 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1701600910025Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1701600910431 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1701600898381-1701600910009 at 1701600910850 (+419 ms)Loading Region manifests for hbase-failsafe-snaptb-1701600898381-1701600910009 at 1701600910850Writing data manifest for hbase-failsafe-snaptb-1701600898381-1701600910009 at 1701600910853 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1701600898381-1701600910009 at 1701600911259 (+406 ms)Snapshot hbase-failsafe-snaptb-1701600898381-1701600910009 of table testCompactionWithHFileLink completed at 1701600911275 (+16 ms) 2023-12-03 10:55:11,277 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-12-03 10:55:11,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2540 sec 2023-12-03 10:55:12,131 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-12-03 10:55:12,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-12-03 10:55:12,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1701600898381-1701600910009 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-12-03 10:55:12,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1701600898381" table: "testCompactionWithHFileLink" creation_time: 1701600898391 type: FLUSH version: 2 ttl: 0 ) 2023-12-03 10:55:12,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1701600898381 as table=testCompactionWithHFileLink 2023-12-03 10:55:12,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-12-03 10:55:12,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-12-03 10:55:12,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-12-03 10:55:12,579 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-12-03 10:55:12,580 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-12-03 10:55:12,580 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-12-03 10:55:12,581 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-12-03 10:55:12,586 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1701600898381" table: "testCompactionWithHFileLink" creation_time: 1701600898391 type: FLUSH version: 2 ttl: 0 2023-12-03 10:55:12,586 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink 2023-12-03 10:55:12,591 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-12-03 10:55:12,594 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312037d7b211fd576475bb09e730af34c8b19 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202312037d7b211fd576475bb09e730af34c8b19 2023-12-03 10:55:12,596 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203cc6a26a77f754612853e2d90a6752460 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231203cc6a26a77f754612853e2d90a6752460 2023-12-03 10:55:12,597 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312035ba2d4a4c7f444f7b6e6f0cec5f05587 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312035ba2d4a4c7f444f7b6e6f0cec5f05587 2023-12-03 10:55:12,597 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202312032fb3e8a0e9f24fdcba1bbdd826ea7960 of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,600 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202312037ff4a72cdd19407c9e22ccdbd0f0217c of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,603 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231203d78c7071d96d44368c2354c38d0330ad of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,606 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231203dc84e0647c2b44d7957e38fc5977dcf6 of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,609 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202312032e90e14765544c32aa3c367fafa64834 of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,613 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202312035a81da2ec3204552a8c008e1f373ce9b of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,616 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202312037a6f50af4b3b4f2e99a9393ff2828675 of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,619 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202312039fbb451648694461855b105224707bbe of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,623 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023120331a6522ef732428fb47c5cc2fc1cdd65 of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,626 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202312037192e36becbf4d11b19a3d7dc71df0c5 of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,629 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231203886c17d39a634a4a8d98490294e521ba of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,632 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202312039a55e318e7bf4043a874a621d150e375 of snapshot=snaptb-1701600898381 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-12-03 10:55:12,637 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231203c97cb58fec064b2ba1466fcac5fcfcce_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231203c97cb58fec064b2ba1466fcac5fcfcce_del 2023-12-03 10:55:12,638 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203a35189a80b2343b78f429815e0701047_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231203a35189a80b2343b78f429815e0701047_del 2023-12-03 10:55:12,639 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023120358e1cc0aeecb4db2ba0b7eb2f9d5520e_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023120358e1cc0aeecb4db2ba0b7eb2f9d5520e_del 2023-12-03 10:55:12,639 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 165139cb0d2367959816aa2994261e13 2023-12-03 10:55:12,639 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:12,640 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:12,643 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/1ebe1d6580914ff5b5a4417acaadb086_SeqId_29_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/1ebe1d6580914ff5b5a4417acaadb086_SeqId_29_ 2023-12-03 10:55:12,643 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/479d74da970a4f10acd9371a92b3baba_SeqId_29_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/479d74da970a4f10acd9371a92b3baba_SeqId_29_ 2023-12-03 10:55:12,643 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/7cd6ebdd5ccf48d59d7ca3c93da5d2b1 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/7cd6ebdd5ccf48d59d7ca3c93da5d2b1 2023-12-03 10:55:12,645 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/2dbc4a9efc2c40e2ace9deaa33432168 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/2dbc4a9efc2c40e2ace9deaa33432168 2023-12-03 10:55:12,645 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4dc65ae32dcf44af959362ea68bf3693 of snapshot=snaptb-1701600898381 to region=4132a9cb8c9f3da44edb46b737bab3eb table=testCompactionWithHFileLink 2023-12-03 10:55:12,645 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/710d3056c23d4361860d868ccaeb27f0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/710d3056c23d4361860d868ccaeb27f0 2023-12-03 10:55:12,645 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e7bd6d082e92415daac620fd2806e1d8_SeqId_29_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/e7bd6d082e92415daac620fd2806e1d8_SeqId_29_ 2023-12-03 10:55:12,645 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e43b3fa2b8e5474881d0759f01b6c5d3 of snapshot=snaptb-1701600898381 to region=8b5495b1604bfe1ccf77f0ddde66fab7 table=testCompactionWithHFileLink 2023-12-03 10:55:12,645 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e0d4934c6dbd45169ffa0078c6990601 of snapshot=snaptb-1701600898381 to region=165139cb0d2367959816aa2994261e13 table=testCompactionWithHFileLink 2023-12-03 10:55:12,664 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 944e31b1d3a0437794d9a87c2d52b596 of snapshot=snaptb-1701600898381 to region=165139cb0d2367959816aa2994261e13 table=testCompactionWithHFileLink 2023-12-03 10:55:12,664 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a30088f6b1f84470b5cfbe8c4a42815c of snapshot=snaptb-1701600898381 to region=4132a9cb8c9f3da44edb46b737bab3eb table=testCompactionWithHFileLink 2023-12-03 10:55:12,665 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 21fd338ec3974795a5b8da570805fdd6 of snapshot=snaptb-1701600898381 to region=8b5495b1604bfe1ccf77f0ddde66fab7 table=testCompactionWithHFileLink 2023-12-03 10:55:12,669 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 08c8f4ef453f455baf39084fbc2a539a of snapshot=snaptb-1701600898381 to region=165139cb0d2367959816aa2994261e13 table=testCompactionWithHFileLink 2023-12-03 10:55:12,671 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5001cc7cdfde4476a5d577904b0bc169 of snapshot=snaptb-1701600898381 to region=4132a9cb8c9f3da44edb46b737bab3eb table=testCompactionWithHFileLink 2023-12-03 10:55:12,671 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1b66cacb21f74e3d85e983e84323bf7c of snapshot=snaptb-1701600898381 to region=8b5495b1604bfe1ccf77f0ddde66fab7 table=testCompactionWithHFileLink 2023-12-03 10:55:12,673 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dea52f33c07e401fb6278611b4368409 of snapshot=snaptb-1701600898381 to region=165139cb0d2367959816aa2994261e13 table=testCompactionWithHFileLink 2023-12-03 10:55:12,675 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c9a58476ea00423db2ca3619d93bd624 of snapshot=snaptb-1701600898381 to region=4132a9cb8c9f3da44edb46b737bab3eb table=testCompactionWithHFileLink 2023-12-03 10:55:12,676 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c2b878ed45eb4fe18d5b8a30ac1b6841 of snapshot=snaptb-1701600898381 to region=8b5495b1604bfe1ccf77f0ddde66fab7 table=testCompactionWithHFileLink 2023-12-03 10:55:12,679 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/cf1f5245a9ab4c909ea7ead288918e40 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/cf1f5245a9ab4c909ea7ead288918e40 2023-12-03 10:55:12,679 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4f668439be874cd7b85324d646f88bcf of snapshot=snaptb-1701600898381 to region=165139cb0d2367959816aa2994261e13 table=testCompactionWithHFileLink 2023-12-03 10:55:12,681 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/3456d29aa954445d92cbe5561de4bd16 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/3456d29aa954445d92cbe5561de4bd16 2023-12-03 10:55:12,681 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d529de4a505142ff8bd105432af5436a of snapshot=snaptb-1701600898381 to region=4132a9cb8c9f3da44edb46b737bab3eb table=testCompactionWithHFileLink 2023-12-03 10:55:12,681 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/481796dce2424aab810d895758287a57 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/481796dce2424aab810d895758287a57 2023-12-03 10:55:12,681 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4530ade4e6bb4a5893f6ffa53f9542c8 of snapshot=snaptb-1701600898381 to region=8b5495b1604bfe1ccf77f0ddde66fab7 table=testCompactionWithHFileLink 2023-12-03 10:55:12,684 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 38a7435be03a43f1a3d0d95e3b28cd49 of snapshot=snaptb-1701600898381 to region=165139cb0d2367959816aa2994261e13 table=testCompactionWithHFileLink 2023-12-03 10:55:12,685 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6c6974e9423f4bd9832f83c689cb3791 of snapshot=snaptb-1701600898381 to region=4132a9cb8c9f3da44edb46b737bab3eb table=testCompactionWithHFileLink 2023-12-03 10:55:12,685 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2fe25c047e0c45149cb46e91aff149f3 of snapshot=snaptb-1701600898381 to region=8b5495b1604bfe1ccf77f0ddde66fab7 table=testCompactionWithHFileLink 2023-12-03 10:55:12,687 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7e7d2af92dfd467bb7a9fa912a9d7fd0 of snapshot=snaptb-1701600898381 to region=165139cb0d2367959816aa2994261e13 table=testCompactionWithHFileLink 2023-12-03 10:55:12,689 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b115aaf2ec834a13a00f46dabf38ebcf of snapshot=snaptb-1701600898381 to region=4132a9cb8c9f3da44edb46b737bab3eb table=testCompactionWithHFileLink 2023-12-03 10:55:12,689 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 022680dab498448682466b98407e4ca6 of snapshot=snaptb-1701600898381 to region=8b5495b1604bfe1ccf77f0ddde66fab7 table=testCompactionWithHFileLink 2023-12-03 10:55:12,691 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fe754da40a8e45f7bee253ee9b44b794 of snapshot=snaptb-1701600898381 to region=165139cb0d2367959816aa2994261e13 table=testCompactionWithHFileLink 2023-12-03 10:55:12,693 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2215d1dbf9914e2480c0efd66c2a9e79 of snapshot=snaptb-1701600898381 to region=8b5495b1604bfe1ccf77f0ddde66fab7 table=testCompactionWithHFileLink 2023-12-03 10:55:12,693 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2cc5a6f8db354cd8a7ae0ac3059a1832 of snapshot=snaptb-1701600898381 to region=4132a9cb8c9f3da44edb46b737bab3eb table=testCompactionWithHFileLink 2023-12-03 10:55:12,697 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1701600898381" table: "testCompactionWithHFileLink" creation_time: 1701600898391 type: FLUSH version: 2 ttl: 0 2023-12-03 10:55:12,698 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701600912698"}]},"ts":"9223372036854775807"} 2023-12-03 10:55:12,698 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701600912698"}]},"ts":"9223372036854775807"} 2023-12-03 10:55:12,698 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701600912698"}]},"ts":"9223372036854775807"} 2023-12-03 10:55:12,700 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-12-03 10:55:12,700 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 165139cb0d2367959816aa2994261e13, NAME => 'testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 4132a9cb8c9f3da44edb46b737bab3eb, NAME => 'testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8b5495b1604bfe1ccf77f0ddde66fab7, NAME => 'testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.', STARTKEY => '1', ENDKEY => '2'}] 2023-12-03 10:55:12,700 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600912699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600912699"}]},"ts":"1701600912699"} 2023-12-03 10:55:12,701 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600912699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600912699"}]},"ts":"1701600912699"} 2023-12-03 10:55:12,701 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600912699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600912699"}]},"ts":"1701600912699"} 2023-12-03 10:55:12,703 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-12-03 10:55:12,703 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-12-03 10:55:12,703 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 165139cb0d2367959816aa2994261e13, NAME => 'testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 4132a9cb8c9f3da44edb46b737bab3eb, NAME => 'testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8b5495b1604bfe1ccf77f0ddde66fab7, NAME => 'testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.', STARTKEY => '1', ENDKEY => '2'}] 2023-12-03 10:55:12,703 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1701600898381 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-12-03 10:55:12,705 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1701600898381" table: "testCompactionWithHFileLink" creation_time: 1701600898391 type: FLUSH version: 2 ttl: 0 ) in 543 msec 2023-12-03 10:55:12,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-12-03 10:55:12,776 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-12-03 10:55:12,776 INFO [Listener at localhost/33475] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1701600898381-1701600910009 2023-12-03 10:55:12,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1701600898381-1701600910009" 2023-12-03 10:55:12,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1701600898381-1701600910009 2023-12-03 10:55:12,787 INFO [Listener at localhost/33475] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-12-03 10:55:12,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-12-03 10:55:12,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-12-03 10:55:12,802 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-12-03 10:55:12,802 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600912802"}]},"ts":"1701600912802"} 2023-12-03 10:55:12,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-12-03 10:55:12,803 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-12-03 10:55:12,805 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-12-03 10:55:12,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, ASSIGN}] 2023-12-03 10:55:12,806 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, ASSIGN 2023-12-03 10:55:12,806 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, ASSIGN 2023-12-03 10:55:12,806 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, ASSIGN 2023-12-03 10:55:12,807 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-12-03 10:55:12,807 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-12-03 10:55:12,807 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-12-03 10:55:12,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-12-03 10:55:12,958 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=8b5495b1604bfe1ccf77f0ddde66fab7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:12,958 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=4132a9cb8c9f3da44edb46b737bab3eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:12,958 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=165139cb0d2367959816aa2994261e13, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:12,959 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600912958"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600912958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600912958"}]},"ts":"1701600912958"} 2023-12-03 10:55:12,959 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600912958"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600912958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600912958"}]},"ts":"1701600912958"} 2023-12-03 10:55:12,959 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600912958"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600912958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600912958"}]},"ts":"1701600912958"} 2023-12-03 10:55:12,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 8b5495b1604bfe1ccf77f0ddde66fab7, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:12,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 4132a9cb8c9f3da44edb46b737bab3eb, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:12,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure 165139cb0d2367959816aa2994261e13, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:13,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-12-03 10:55:13,112 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:13,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:13,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8b5495b1604bfe1ccf77f0ddde66fab7, NAME => 'testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.', STARTKEY => '1', ENDKEY => '2'} 2023-12-03 10:55:13,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:13,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:13,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:13,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:13,116 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:13,117 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1 2023-12-03 10:55:13,117 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1 2023-12-03 10:55:13,117 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b5495b1604bfe1ccf77f0ddde66fab7 columnFamilyName family1 2023-12-03 10:55:13,126 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-1b66cacb21f74e3d85e983e84323bf7c 2023-12-03 10:55:13,131 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-21fd338ec3974795a5b8da570805fdd6 2023-12-03 10:55:13,136 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-c2b878ed45eb4fe18d5b8a30ac1b6841 2023-12-03 10:55:13,140 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-e43b3fa2b8e5474881d0759f01b6c5d3 2023-12-03 10:55:13,140 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(310): Store=8b5495b1604bfe1ccf77f0ddde66fab7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:13,141 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:13,141 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2 2023-12-03 10:55:13,141 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2 2023-12-03 10:55:13,142 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b5495b1604bfe1ccf77f0ddde66fab7 columnFamilyName family2 2023-12-03 10:55:13,148 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-022680dab498448682466b98407e4ca6 2023-12-03 10:55:13,153 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2215d1dbf9914e2480c0efd66c2a9e79 2023-12-03 10:55:13,157 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2fe25c047e0c45149cb46e91aff149f3 2023-12-03 10:55:13,163 DEBUG [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-4530ade4e6bb4a5893f6ffa53f9542c8 2023-12-03 10:55:13,163 INFO [StoreOpener-8b5495b1604bfe1ccf77f0ddde66fab7-1] regionserver.HStore(310): Store=8b5495b1604bfe1ccf77f0ddde66fab7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:13,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:13,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:13,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:55:13,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:13,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8b5495b1604bfe1ccf77f0ddde66fab7; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70088074, jitterRate=0.044393688440322876}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:55:13,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:55:13,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7., pid=101, masterSystemTime=1701600913112 2023-12-03 10:55:13,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:55:13,170 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-12-03 10:55:13,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:55:13,170 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-12-03 10:55:13,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:13,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:13,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:13,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4132a9cb8c9f3da44edb46b737bab3eb, NAME => 'testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.', STARTKEY => '', ENDKEY => '1'} 2023-12-03 10:55:13,172 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=8b5495b1604bfe1ccf77f0ddde66fab7, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:13,172 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600913172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600913172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600913172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600913172"}]},"ts":"1701600913172"} 2023-12-03 10:55:13,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:13,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:13,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:13,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:13,173 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-12-03 10:55:13,173 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1912): 8b5495b1604bfe1ccf77f0ddde66fab7/family1 is initiating minor compaction (all files) 2023-12-03 10:55:13,173 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8b5495b1604bfe1ccf77f0ddde66fab7/family1 in testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:13,173 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-e43b3fa2b8e5474881d0759f01b6c5d3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-21fd338ec3974795a5b8da570805fdd6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-1b66cacb21f74e3d85e983e84323bf7c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-c2b878ed45eb4fe18d5b8a30ac1b6841] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp, totalSize=21.6 K 2023-12-03 10:55:13,174 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:13,174 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-12-03 10:55:13,174 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HStore(1912): 8b5495b1604bfe1ccf77f0ddde66fab7/family2 is initiating minor compaction (all files) 2023-12-03 10:55:13,174 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 8b5495b1604bfe1ccf77f0ddde66fab7/family2 in testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:13,174 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-4530ade4e6bb4a5893f6ffa53f9542c8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2fe25c047e0c45149cb46e91aff149f3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-022680dab498448682466b98407e4ca6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2215d1dbf9914e2480c0efd66c2a9e79] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp, totalSize=20.4 K 2023-12-03 10:55:13,174 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-e43b3fa2b8e5474881d0759f01b6c5d3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891196 2023-12-03 10:55:13,175 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1 2023-12-03 10:55:13,175 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1 2023-12-03 10:55:13,175 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4132a9cb8c9f3da44edb46b737bab3eb columnFamilyName family1 2023-12-03 10:55:13,175 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-4530ade4e6bb4a5893f6ffa53f9542c8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891196 2023-12-03 10:55:13,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=101, resume processing ppid=99 2023-12-03 10:55:13,175 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-21fd338ec3974795a5b8da570805fdd6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892995 2023-12-03 10:55:13,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 8b5495b1604bfe1ccf77f0ddde66fab7, server=jenkins-hbase4.apache.org,44259,1701600798821 in 214 msec 2023-12-03 10:55:13,176 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2fe25c047e0c45149cb46e91aff149f3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892995 2023-12-03 10:55:13,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8b5495b1604bfe1ccf77f0ddde66fab7, ASSIGN in 369 msec 2023-12-03 10:55:13,177 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-1b66cacb21f74e3d85e983e84323bf7c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894808 2023-12-03 10:55:13,177 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-022680dab498448682466b98407e4ca6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894808 2023-12-03 10:55:13,177 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-c2b878ed45eb4fe18d5b8a30ac1b6841, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896596 2023-12-03 10:55:13,178 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2215d1dbf9914e2480c0efd66c2a9e79, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896596 2023-12-03 10:55:13,190 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-4dc65ae32dcf44af959362ea68bf3693 2023-12-03 10:55:13,199 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-5001cc7cdfde4476a5d577904b0bc169 2023-12-03 10:55:13,213 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-a30088f6b1f84470b5cfbe8c4a42815c 2023-12-03 10:55:13,220 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8b5495b1604bfe1ccf77f0ddde66fab7#family1#compaction#114 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:55:13,223 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-c9a58476ea00423db2ca3619d93bd624 2023-12-03 10:55:13,224 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(310): Store=4132a9cb8c9f3da44edb46b737bab3eb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:13,225 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:13,225 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2 2023-12-03 10:55:13,225 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2 2023-12-03 10:55:13,226 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4132a9cb8c9f3da44edb46b737bab3eb columnFamilyName family2 2023-12-03 10:55:13,231 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] throttle.PressureAwareThroughputController(145): 8b5495b1604bfe1ccf77f0ddde66fab7#family2#compaction#115 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:55:13,240 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-2cc5a6f8db354cd8a7ae0ac3059a1832 2023-12-03 10:55:13,244 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-6c6974e9423f4bd9832f83c689cb3791 2023-12-03 10:55:13,249 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-b115aaf2ec834a13a00f46dabf38ebcf 2023-12-03 10:55:13,253 DEBUG [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-d529de4a505142ff8bd105432af5436a 2023-12-03 10:55:13,253 INFO [StoreOpener-4132a9cb8c9f3da44edb46b737bab3eb-1] regionserver.HStore(310): Store=4132a9cb8c9f3da44edb46b737bab3eb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:13,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:13,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:13,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:55:13,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:13,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4132a9cb8c9f3da44edb46b737bab3eb; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63291231, jitterRate=-0.05688716471195221}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:55:13,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:55:13,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb., pid=102, masterSystemTime=1701600913112 2023-12-03 10:55:13,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-12-03 10:55:13,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-12-03 10:55:13,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:13,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:13,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:13,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 165139cb0d2367959816aa2994261e13, NAME => 'testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.', STARTKEY => '2', ENDKEY => ''} 2023-12-03 10:55:13,261 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=4132a9cb8c9f3da44edb46b737bab3eb, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:13,261 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600913261"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600913261"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600913261"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600913261"}]},"ts":"1701600913261"} 2023-12-03 10:55:13,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 165139cb0d2367959816aa2994261e13 2023-12-03 10:55:13,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:13,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 165139cb0d2367959816aa2994261e13 2023-12-03 10:55:13,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 165139cb0d2367959816aa2994261e13 2023-12-03 10:55:13,263 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 165139cb0d2367959816aa2994261e13 2023-12-03 10:55:13,264 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1 2023-12-03 10:55:13,264 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1 2023-12-03 10:55:13,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=102, resume processing ppid=98 2023-12-03 10:55:13,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 4132a9cb8c9f3da44edb46b737bab3eb, server=jenkins-hbase4.apache.org,44259,1701600798821 in 302 msec 2023-12-03 10:55:13,264 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 165139cb0d2367959816aa2994261e13 columnFamilyName family1 2023-12-03 10:55:13,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4132a9cb8c9f3da44edb46b737bab3eb, ASSIGN in 458 msec 2023-12-03 10:55:13,275 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-08c8f4ef453f455baf39084fbc2a539a 2023-12-03 10:55:13,282 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-944e31b1d3a0437794d9a87c2d52b596 2023-12-03 10:55:13,289 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-dea52f33c07e401fb6278611b4368409 2023-12-03 10:55:13,296 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-e0d4934c6dbd45169ffa0078c6990601 2023-12-03 10:55:13,296 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(310): Store=165139cb0d2367959816aa2994261e13/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:13,296 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 165139cb0d2367959816aa2994261e13 2023-12-03 10:55:13,297 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2 2023-12-03 10:55:13,297 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2 2023-12-03 10:55:13,297 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 165139cb0d2367959816aa2994261e13 columnFamilyName family2 2023-12-03 10:55:13,304 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-38a7435be03a43f1a3d0d95e3b28cd49 2023-12-03 10:55:13,309 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-4f668439be874cd7b85324d646f88bcf 2023-12-03 10:55:13,314 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-7e7d2af92dfd467bb7a9fa912a9d7fd0 2023-12-03 10:55:13,321 DEBUG [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(539): loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-fe754da40a8e45f7bee253ee9b44b794 2023-12-03 10:55:13,321 INFO [StoreOpener-165139cb0d2367959816aa2994261e13-1] regionserver.HStore(310): Store=165139cb0d2367959816aa2994261e13/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:13,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13 2023-12-03 10:55:13,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13 2023-12-03 10:55:13,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:55:13,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 165139cb0d2367959816aa2994261e13 2023-12-03 10:55:13,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 165139cb0d2367959816aa2994261e13; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72264238, jitterRate=0.07682105898857117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:55:13,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:55:13,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13., pid=103, masterSystemTime=1701600913112 2023-12-03 10:55:13,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-12-03 10:55:13,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-12-03 10:55:13,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:13,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:13,330 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=165139cb0d2367959816aa2994261e13, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:13,331 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701600913330"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600913330"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600913330"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600913330"}]},"ts":"1701600913330"} 2023-12-03 10:55:13,331 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46307] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase4.apache.org,44259,1701600798821, table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-12-03 10:55:13,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=103, resume processing ppid=100 2023-12-03 10:55:13,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure 165139cb0d2367959816aa2994261e13, server=jenkins-hbase4.apache.org,44259,1701600798821 in 371 msec 2023-12-03 10:55:13,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=100, resume processing ppid=97 2023-12-03 10:55:13,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=165139cb0d2367959816aa2994261e13, ASSIGN in 528 msec 2023-12-03 10:55:13,336 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600913336"}]},"ts":"1701600913336"} 2023-12-03 10:55:13,337 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-12-03 10:55:13,339 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-12-03 10:55:13,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 546 msec 2023-12-03 10:55:13,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-12-03 10:55:13,405 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-12-03 10:55:13,419 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:13,428 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:13,435 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:13,436 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:13,443 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-12-03 10:55:13,456 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-12-03 10:55:13,456 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:13,457 DEBUG [Listener at localhost/33475] zookeeper.ReadOnlyZKClient(139): Connect 0x209c1885 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:55:13,464 DEBUG [Listener at localhost/33475] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46f43b9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:55:13,464 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:13,464 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:13,464 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:13,957 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312032bc1ea028ba440a2b4e9a0445e28841a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202312032bc1ea028ba440a2b4e9a0445e28841a 2023-12-03 10:55:13,958 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312038e4558ec422c422b81f1d902cab0fe85 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202312038e4558ec422c422b81f1d902cab0fe85 2023-12-03 10:55:13,958 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:13,958 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:13,966 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203210f7535dc0f48fdadf1b952649bdf1a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231203210f7535dc0f48fdadf1b952649bdf1a 2023-12-03 10:55:13,967 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:13,974 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:55:13,977 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:55:13,984 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:55:13,993 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:55:14,017 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231203/family1/b5a4937a08d6423bb02c436e48e43325 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-12-03 10:55:14,018 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=32 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231203/family1/b5a4937a08d6423bb02c436e48e43325}] 2023-12-03 10:55:14,018 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231203/family1/31faaa2c1088499a90f933b72f37d1bd first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-12-03 10:55:14,019 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231203/family1/8c793e1b939649a6a607b0abe6564180 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-12-03 10:55:14,019 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231203/family1/31faaa2c1088499a90f933b72f37d1bd}] 2023-12-03 10:55:14,025 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231203/family1/8c793e1b939649a6a607b0abe6564180}] 2023-12-03 10:55:14,026 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231203/family1/b5a4937a08d6423bb02c436e48e43325 for inclusion in 4132a9cb8c9f3da44edb46b737bab3eb/family1 2023-12-03 10:55:14,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231203/family1/31faaa2c1088499a90f933b72f37d1bd for inclusion in 165139cb0d2367959816aa2994261e13/family1 2023-12-03 10:55:14,027 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231203/family1/8c793e1b939649a6a607b0abe6564180 for inclusion in 8b5495b1604bfe1ccf77f0ddde66fab7/family1 2023-12-03 10:55:14,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-12-03 10:55:14,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first=2 last= 2023-12-03 10:55:14,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:55:14,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-12-03 10:55:14,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last=1 2023-12-03 10:55:14,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:55:14,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-12-03 10:55:14,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(777): Region bounds: first=1 last=2 2023-12-03 10:55:14,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:55:14,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231203/family1/31faaa2c1088499a90f933b72f37d1bd to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__oqt8ioai0e9rqlgb10qcgnf9ecvg93n8umqkanv8jg5vq1aim8ssmr1mks1ah3mm/family1/31faaa2c1088499a90f933b72f37d1bd 2023-12-03 10:55:14,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231203/family1/b5a4937a08d6423bb02c436e48e43325 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__dqmpl1h6v97c569fmskc5s2018qtoptikn5oaeed43p4gc8em2fqs9i85qc0kino/family1/b5a4937a08d6423bb02c436e48e43325 2023-12-03 10:55:14,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231203/family1/8c793e1b939649a6a607b0abe6564180 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__jaos4eb4lm2i98r3ts3fd11t8dvke7st4er8j209v1hvkjnfaflt9t45pai8d76h/family1/8c793e1b939649a6a607b0abe6564180 2023-12-03 10:55:14,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__oqt8ioai0e9rqlgb10qcgnf9ecvg93n8umqkanv8jg5vq1aim8ssmr1mks1ah3mm/family1/31faaa2c1088499a90f933b72f37d1bd as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/4c59f8dbac0e4787becd68f197565f20_SeqId_34_ 2023-12-03 10:55:14,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__dqmpl1h6v97c569fmskc5s2018qtoptikn5oaeed43p4gc8em2fqs9i85qc0kino/family1/b5a4937a08d6423bb02c436e48e43325 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/fe84ea470ade4f79921eed26193c5016_SeqId_34_ 2023-12-03 10:55:14,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__oqt8ioai0e9rqlgb10qcgnf9ecvg93n8umqkanv8jg5vq1aim8ssmr1mks1ah3mm/family1/31faaa2c1088499a90f933b72f37d1bd into 165139cb0d2367959816aa2994261e13/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/4c59f8dbac0e4787becd68f197565f20_SeqId_34_ - updating store file list. 2023-12-03 10:55:14,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__jaos4eb4lm2i98r3ts3fd11t8dvke7st4er8j209v1hvkjnfaflt9t45pai8d76h/family1/8c793e1b939649a6a607b0abe6564180 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/4a678aa7bb8f476a8dc0e396bbf59fd1_SeqId_34_ 2023-12-03 10:55:14,039 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__dqmpl1h6v97c569fmskc5s2018qtoptikn5oaeed43p4gc8em2fqs9i85qc0kino/family1/b5a4937a08d6423bb02c436e48e43325 into 4132a9cb8c9f3da44edb46b737bab3eb/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/fe84ea470ade4f79921eed26193c5016_SeqId_34_ - updating store file list. 2023-12-03 10:55:14,040 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__jaos4eb4lm2i98r3ts3fd11t8dvke7st4er8j209v1hvkjnfaflt9t45pai8d76h/family1/8c793e1b939649a6a607b0abe6564180 into 8b5495b1604bfe1ccf77f0ddde66fab7/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/4a678aa7bb8f476a8dc0e396bbf59fd1_SeqId_34_ - updating store file list. 2023-12-03 10:55:14,044 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/fe84ea470ade4f79921eed26193c5016_SeqId_34_ into 4132a9cb8c9f3da44edb46b737bab3eb/family1 2023-12-03 10:55:14,044 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__dqmpl1h6v97c569fmskc5s2018qtoptikn5oaeed43p4gc8em2fqs9i85qc0kino/family1/b5a4937a08d6423bb02c436e48e43325 into 4132a9cb8c9f3da44edb46b737bab3eb/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/fe84ea470ade4f79921eed26193c5016_SeqId_34_) 2023-12-03 10:55:14,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/4c59f8dbac0e4787becd68f197565f20_SeqId_34_ into 165139cb0d2367959816aa2994261e13/family1 2023-12-03 10:55:14,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__oqt8ioai0e9rqlgb10qcgnf9ecvg93n8umqkanv8jg5vq1aim8ssmr1mks1ah3mm/family1/31faaa2c1088499a90f933b72f37d1bd into 165139cb0d2367959816aa2994261e13/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/4c59f8dbac0e4787becd68f197565f20_SeqId_34_) 2023-12-03 10:55:14,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__dqmpl1h6v97c569fmskc5s2018qtoptikn5oaeed43p4gc8em2fqs9i85qc0kino/family1/b5a4937a08d6423bb02c436e48e43325 2023-12-03 10:55:14,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:14,046 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/4a678aa7bb8f476a8dc0e396bbf59fd1_SeqId_34_ into 8b5495b1604bfe1ccf77f0ddde66fab7/family1 2023-12-03 10:55:14,046 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__jaos4eb4lm2i98r3ts3fd11t8dvke7st4er8j209v1hvkjnfaflt9t45pai8d76h/family1/8c793e1b939649a6a607b0abe6564180 into 8b5495b1604bfe1ccf77f0ddde66fab7/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/4a678aa7bb8f476a8dc0e396bbf59fd1_SeqId_34_) 2023-12-03 10:55:14,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__oqt8ioai0e9rqlgb10qcgnf9ecvg93n8umqkanv8jg5vq1aim8ssmr1mks1ah3mm/family1/31faaa2c1088499a90f933b72f37d1bd 2023-12-03 10:55:14,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testCompactionWithHFileLink__jaos4eb4lm2i98r3ts3fd11t8dvke7st4er8j209v1hvkjnfaflt9t45pai8d76h/family1/8c793e1b939649a6a607b0abe6564180 2023-12-03 10:55:14,051 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:14,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-12-03 10:55:14,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(1912): 4132a9cb8c9f3da44edb46b737bab3eb/family1 is initiating minor compaction (all files) 2023-12-03 10:55:14,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3f4a28ca; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-12-03 10:55:14,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:14,052 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:14,052 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family1/69a10be45de34071a6360bdc746b046a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/69a10be45de34071a6360bdc746b046a 2023-12-03 10:55:14,054 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:14,054 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202312032fb3e8a0e9f24fdcba1bbdd826ea7960 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202312032fb3e8a0e9f24fdcba1bbdd826ea7960 2023-12-03 10:55:14,055 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:14,057 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202312037ff4a72cdd19407c9e22ccdbd0f0217c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202312037ff4a72cdd19407c9e22ccdbd0f0217c 2023-12-03 10:55:14,057 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023120331a6522ef732428fb47c5cc2fc1cdd65 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023120331a6522ef732428fb47c5cc2fc1cdd65 2023-12-03 10:55:14,058 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231203d78c7071d96d44368c2354c38d0330ad to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231203d78c7071d96d44368c2354c38d0330ad 2023-12-03 10:55:14,058 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/.tmp/family2/5ae87256eede406c99103f3fb4125805 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/5ae87256eede406c99103f3fb4125805 2023-12-03 10:55:14,059 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202312037192e36becbf4d11b19a3d7dc71df0c5 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202312037192e36becbf4d11b19a3d7dc71df0c5 2023-12-03 10:55:14,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-12-03 10:55:14,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(1912): 165139cb0d2367959816aa2994261e13/family1 is initiating minor compaction (all files) 2023-12-03 10:55:14,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@49d21fe2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-12-03 10:55:14,060 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 8b5495b1604bfe1ccf77f0ddde66fab7/family1 of 8b5495b1604bfe1ccf77f0ddde66fab7 into 69a10be45de34071a6360bdc746b046a(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:14,061 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:55:14,061 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7., storeName=8b5495b1604bfe1ccf77f0ddde66fab7/family1, priority=12, startTime=1701600913169; duration=0sec 2023-12-03 10:55:14,061 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-12-03 10:55:14,061 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4132a9cb8c9f3da44edb46b737bab3eb/family1 in testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:14,061 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231203886c17d39a634a4a8d98490294e521ba to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231203886c17d39a634a4a8d98490294e521ba 2023-12-03 10:55:14,061 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-4dc65ae32dcf44af959362ea68bf3693, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-a30088f6b1f84470b5cfbe8c4a42815c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-5001cc7cdfde4476a5d577904b0bc169, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-c9a58476ea00423db2ca3619d93bd624, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/fe84ea470ade4f79921eed26193c5016_SeqId_34_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp, totalSize=28.9 K 2023-12-03 10:55:14,061 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231203dc84e0647c2b44d7957e38fc5977dcf6 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231203dc84e0647c2b44d7957e38fc5977dcf6 2023-12-03 10:55:14,061 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-12-03 10:55:14,061 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231203' 2023-12-03 10:55:14,062 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-4dc65ae32dcf44af959362ea68bf3693, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891194 2023-12-03 10:55:14,062 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:14,063 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202312039a55e318e7bf4043a874a621d150e375 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202312039a55e318e7bf4043a874a621d150e375 2023-12-03 10:55:14,063 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-12-03 10:55:14,063 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231203' 2023-12-03 10:55:14,063 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-a30088f6b1f84470b5cfbe8c4a42815c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892994 2023-12-03 10:55:14,063 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231203 table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:14,063 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:14,064 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-5001cc7cdfde4476a5d577904b0bc169, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894807 2023-12-03 10:55:14,064 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:14,065 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-c9a58476ea00423db2ca3619d93bd624, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896595 2023-12-03 10:55:14,065 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting fe84ea470ade4f79921eed26193c5016_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1701600891194 2023-12-03 10:55:14,065 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 8b5495b1604bfe1ccf77f0ddde66fab7/family2 of 8b5495b1604bfe1ccf77f0ddde66fab7 into 5ae87256eede406c99103f3fb4125805(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:14,065 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:55:14,066 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7., storeName=8b5495b1604bfe1ccf77f0ddde66fab7/family2, priority=12, startTime=1701600913170; duration=0sec 2023-12-03 10:55:14,066 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202312032e90e14765544c32aa3c367fafa64834 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202312032e90e14765544c32aa3c367fafa64834 2023-12-03 10:55:14,066 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-12-03 10:55:14,066 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 165139cb0d2367959816aa2994261e13/family1 in testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:14,066 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-e0d4934c6dbd45169ffa0078c6990601, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-944e31b1d3a0437794d9a87c2d52b596, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-08c8f4ef453f455baf39084fbc2a539a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-dea52f33c07e401fb6278611b4368409, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/4c59f8dbac0e4787becd68f197565f20_SeqId_34_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp, totalSize=28.9 K 2023-12-03 10:55:14,067 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202312035a81da2ec3204552a8c008e1f373ce9b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202312035a81da2ec3204552a8c008e1f373ce9b 2023-12-03 10:55:14,067 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-e0d4934c6dbd45169ffa0078c6990601, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891197 2023-12-03 10:55:14,068 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202312037a6f50af4b3b4f2e99a9393ff2828675 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202312037a6f50af4b3b4f2e99a9393ff2828675 2023-12-03 10:55:14,068 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-944e31b1d3a0437794d9a87c2d52b596, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892995 2023-12-03 10:55:14,068 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-08c8f4ef453f455baf39084fbc2a539a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894808 2023-12-03 10:55:14,069 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202312039fbb451648694461855b105224707bbe to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202312039fbb451648694461855b105224707bbe 2023-12-03 10:55:14,069 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-12-03 10:55:14,069 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231203' 2023-12-03 10:55:14,069 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-dea52f33c07e401fb6278611b4368409, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896596 2023-12-03 10:55:14,069 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231203 for table='testCompactionWithHFileLink' and column='family1' 2023-12-03 10:55:14,069 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-12-03 10:55:14,069 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting 4c59f8dbac0e4787becd68f197565f20_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1701600891197 2023-12-03 10:55:14,072 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:14,076 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:14,080 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:14,081 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:14,082 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4132a9cb8c9f3da44edb46b737bab3eb#family1#compaction#116 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:55:14,088 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:14,089 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:14,106 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] throttle.PressureAwareThroughputController(145): 165139cb0d2367959816aa2994261e13#family1#compaction#117 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:55:14,122 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=298 (was 240) - Thread LEAK? -, OpenFileDescriptor=810 (was 620) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=167 (was 183), ProcessCount=170 (was 170), AvailableMemoryMB=3120 (was 3137) 2023-12-03 10:55:14,136 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=297, OpenFileDescriptor=806, MaxFileDescriptor=60000, SystemLoadAverage=167, ProcessCount=170, AvailableMemoryMB=3118 2023-12-03 10:55:14,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-12-03 10:55:14,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-12-03 10:55:14,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-12-03 10:55:14,149 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-12-03 10:55:14,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-12-03 10:55:14,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-e43b3fa2b8e5474881d0759f01b6c5d3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-21fd338ec3974795a5b8da570805fdd6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-1b66cacb21f74e3d85e983e84323bf7c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-c2b878ed45eb4fe18d5b8a30ac1b6841] to archive 2023-12-03 10:55:14,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:14,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-e43b3fa2b8e5474881d0759f01b6c5d3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-e43b3fa2b8e5474881d0759f01b6c5d3 2023-12-03 10:55:14,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-21fd338ec3974795a5b8da570805fdd6 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-21fd338ec3974795a5b8da570805fdd6 2023-12-03 10:55:14,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-1b66cacb21f74e3d85e983e84323bf7c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-1b66cacb21f74e3d85e983e84323bf7c 2023-12-03 10:55:14,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-c2b878ed45eb4fe18d5b8a30ac1b6841 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family1/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-c2b878ed45eb4fe18d5b8a30ac1b6841 2023-12-03 10:55:14,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-4530ade4e6bb4a5893f6ffa53f9542c8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2fe25c047e0c45149cb46e91aff149f3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-022680dab498448682466b98407e4ca6, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2215d1dbf9914e2480c0efd66c2a9e79] to archive 2023-12-03 10:55:14,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:14,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-4530ade4e6bb4a5893f6ffa53f9542c8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-4530ade4e6bb4a5893f6ffa53f9542c8 2023-12-03 10:55:14,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2fe25c047e0c45149cb46e91aff149f3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2fe25c047e0c45149cb46e91aff149f3 2023-12-03 10:55:14,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-022680dab498448682466b98407e4ca6 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-022680dab498448682466b98407e4ca6 2023-12-03 10:55:14,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2215d1dbf9914e2480c0efd66c2a9e79 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/family2/testCompactionWithHFileLink=8b5495b1604bfe1ccf77f0ddde66fab7-2215d1dbf9914e2480c0efd66c2a9e79 2023-12-03 10:55:14,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-12-03 10:55:14,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-12-03 10:55:14,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-12-03 10:55:14,252 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:55:14,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-12-03 10:55:14,253 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:55:14,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-12-03 10:55:14,255 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:14,255 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:14,255 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:14,255 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579 empty. 2023-12-03 10:55:14,255 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9 empty. 2023-12-03 10:55:14,256 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4 empty. 2023-12-03 10:55:14,256 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:14,256 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:14,256 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:14,256 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-12-03 10:55:14,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-12-03 10:55:14,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-12-03 10:55:14,663 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-12-03 10:55:14,665 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 6a2227d5c782c10299a2b96f43c845b4, NAME => 'ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:55:14,665 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8289e8e52c6c796e8f6a76e95ee71cf9, NAME => 'ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:55:14,665 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 236c5a2347aa1bfce918e0fb3cc51579, NAME => 'ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:55:14,670 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:14,670 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 6a2227d5c782c10299a2b96f43c845b4, disabling compactions & flushes 2023-12-03 10:55:14,670 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:14,670 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:14,670 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. after waiting 0 ms 2023-12-03 10:55:14,670 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:14,670 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:14,670 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:14,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-12-03 10:55:15,071 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:15,071 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 8289e8e52c6c796e8f6a76e95ee71cf9, disabling compactions & flushes 2023-12-03 10:55:15,071 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:15,071 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:15,071 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. after waiting 0 ms 2023-12-03 10:55:15,071 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:15,071 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:15,072 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:15,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:15,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 236c5a2347aa1bfce918e0fb3cc51579, disabling compactions & flushes 2023-12-03 10:55:15,074 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:15,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:15,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. after waiting 0 ms 2023-12-03 10:55:15,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:15,074 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:15,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:15,076 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:55:15,077 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701600915077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600915077"}]},"ts":"1701600915077"} 2023-12-03 10:55:15,077 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701600915077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600915077"}]},"ts":"1701600915077"} 2023-12-03 10:55:15,077 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701600915077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600915077"}]},"ts":"1701600915077"} 2023-12-03 10:55:15,079 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-12-03 10:55:15,079 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:55:15,079 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600915079"}]},"ts":"1701600915079"} 2023-12-03 10:55:15,080 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-12-03 10:55:15,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=236c5a2347aa1bfce918e0fb3cc51579, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8289e8e52c6c796e8f6a76e95ee71cf9, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6a2227d5c782c10299a2b96f43c845b4, ASSIGN}] 2023-12-03 10:55:15,092 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6a2227d5c782c10299a2b96f43c845b4, ASSIGN 2023-12-03 10:55:15,092 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8289e8e52c6c796e8f6a76e95ee71cf9, ASSIGN 2023-12-03 10:55:15,092 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=236c5a2347aa1bfce918e0fb3cc51579, ASSIGN 2023-12-03 10:55:15,092 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6a2227d5c782c10299a2b96f43c845b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:55:15,093 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8289e8e52c6c796e8f6a76e95ee71cf9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:55:15,093 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=236c5a2347aa1bfce918e0fb3cc51579, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:55:15,245 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=6a2227d5c782c10299a2b96f43c845b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:15,245 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=236c5a2347aa1bfce918e0fb3cc51579, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:15,245 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8289e8e52c6c796e8f6a76e95ee71cf9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:15,245 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701600915245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600915245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600915245"}]},"ts":"1701600915245"} 2023-12-03 10:55:15,245 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701600915245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600915245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600915245"}]},"ts":"1701600915245"} 2023-12-03 10:55:15,245 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701600915245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600915245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600915245"}]},"ts":"1701600915245"} 2023-12-03 10:55:15,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 6a2227d5c782c10299a2b96f43c845b4, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:15,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 236c5a2347aa1bfce918e0fb3cc51579, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:15,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 8289e8e52c6c796e8f6a76e95ee71cf9, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:15,320 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family1/2fa446fddad54b9d9481e2e1cf3d9ea5 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/2fa446fddad54b9d9481e2e1cf3d9ea5 2023-12-03 10:55:15,324 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family1/a705083025fd497ca4d786ef46b9b0ae as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/a705083025fd497ca4d786ef46b9b0ae 2023-12-03 10:55:15,324 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 4132a9cb8c9f3da44edb46b737bab3eb/family1 of 4132a9cb8c9f3da44edb46b737bab3eb into 2fa446fddad54b9d9481e2e1cf3d9ea5(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:15,325 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:55:15,325 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1701600914051; duration=1sec 2023-12-03 10:55:15,325 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-12-03 10:55:15,325 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-12-03 10:55:15,327 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-12-03 10:55:15,327 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1912): 4132a9cb8c9f3da44edb46b737bab3eb/family2 is initiating minor compaction (all files) 2023-12-03 10:55:15,327 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4132a9cb8c9f3da44edb46b737bab3eb/family2 in testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:15,328 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-d529de4a505142ff8bd105432af5436a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-6c6974e9423f4bd9832f83c689cb3791, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-b115aaf2ec834a13a00f46dabf38ebcf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-2cc5a6f8db354cd8a7ae0ac3059a1832] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp, totalSize=20.4 K 2023-12-03 10:55:15,328 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-d529de4a505142ff8bd105432af5436a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891194 2023-12-03 10:55:15,329 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-6c6974e9423f4bd9832f83c689cb3791, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892994 2023-12-03 10:55:15,329 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 165139cb0d2367959816aa2994261e13/family1 of 165139cb0d2367959816aa2994261e13 into a705083025fd497ca4d786ef46b9b0ae(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:15,329 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:55:15,329 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1701600914060; duration=1sec 2023-12-03 10:55:15,329 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-12-03 10:55:15,330 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-12-03 10:55:15,330 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-b115aaf2ec834a13a00f46dabf38ebcf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894807 2023-12-03 10:55:15,330 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-2cc5a6f8db354cd8a7ae0ac3059a1832, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896595 2023-12-03 10:55:15,332 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-12-03 10:55:15,332 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HStore(1912): 165139cb0d2367959816aa2994261e13/family2 is initiating minor compaction (all files) 2023-12-03 10:55:15,332 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 165139cb0d2367959816aa2994261e13/family2 in testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:15,332 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-4f668439be874cd7b85324d646f88bcf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-38a7435be03a43f1a3d0d95e3b28cd49, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-7e7d2af92dfd467bb7a9fa912a9d7fd0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-fe754da40a8e45f7bee253ee9b44b794] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp, totalSize=20.4 K 2023-12-03 10:55:15,332 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-4f668439be874cd7b85324d646f88bcf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600891197 2023-12-03 10:55:15,333 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-38a7435be03a43f1a3d0d95e3b28cd49, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600892995 2023-12-03 10:55:15,334 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-7e7d2af92dfd467bb7a9fa912a9d7fd0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600894808 2023-12-03 10:55:15,334 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-fe754da40a8e45f7bee253ee9b44b794, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600896596 2023-12-03 10:55:15,343 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4132a9cb8c9f3da44edb46b737bab3eb#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:55:15,347 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] throttle.PressureAwareThroughputController(145): 165139cb0d2367959816aa2994261e13#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-12-03 10:55:15,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-4dc65ae32dcf44af959362ea68bf3693, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-a30088f6b1f84470b5cfbe8c4a42815c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-5001cc7cdfde4476a5d577904b0bc169, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-c9a58476ea00423db2ca3619d93bd624, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/fe84ea470ade4f79921eed26193c5016_SeqId_34_] to archive 2023-12-03 10:55:15,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:15,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-12-03 10:55:15,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-4dc65ae32dcf44af959362ea68bf3693 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-4dc65ae32dcf44af959362ea68bf3693 2023-12-03 10:55:15,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-a30088f6b1f84470b5cfbe8c4a42815c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-a30088f6b1f84470b5cfbe8c4a42815c 2023-12-03 10:55:15,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-5001cc7cdfde4476a5d577904b0bc169 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-5001cc7cdfde4476a5d577904b0bc169 2023-12-03 10:55:15,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-c9a58476ea00423db2ca3619d93bd624 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-c9a58476ea00423db2ca3619d93bd624 2023-12-03 10:55:15,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/fe84ea470ade4f79921eed26193c5016_SeqId_34_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family1/fe84ea470ade4f79921eed26193c5016_SeqId_34_ 2023-12-03 10:55:15,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-e0d4934c6dbd45169ffa0078c6990601, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-944e31b1d3a0437794d9a87c2d52b596, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-08c8f4ef453f455baf39084fbc2a539a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-dea52f33c07e401fb6278611b4368409, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/4c59f8dbac0e4787becd68f197565f20_SeqId_34_] to archive 2023-12-03 10:55:15,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:15,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-e0d4934c6dbd45169ffa0078c6990601 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-e0d4934c6dbd45169ffa0078c6990601 2023-12-03 10:55:15,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-944e31b1d3a0437794d9a87c2d52b596 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-944e31b1d3a0437794d9a87c2d52b596 2023-12-03 10:55:15,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-08c8f4ef453f455baf39084fbc2a539a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-08c8f4ef453f455baf39084fbc2a539a 2023-12-03 10:55:15,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-dea52f33c07e401fb6278611b4368409 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-dea52f33c07e401fb6278611b4368409 2023-12-03 10:55:15,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/4c59f8dbac0e4787becd68f197565f20_SeqId_34_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family1/4c59f8dbac0e4787becd68f197565f20_SeqId_34_ 2023-12-03 10:55:15,398 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:15,401 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:55:15,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:15,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 236c5a2347aa1bfce918e0fb3cc51579, NAME => 'ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579.', STARTKEY => '', ENDKEY => '1'} 2023-12-03 10:55:15,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:15,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:15,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:15,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:15,403 INFO [StoreOpener-236c5a2347aa1bfce918e0fb3cc51579-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:15,404 DEBUG [StoreOpener-236c5a2347aa1bfce918e0fb3cc51579-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1 2023-12-03 10:55:15,404 DEBUG [StoreOpener-236c5a2347aa1bfce918e0fb3cc51579-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1 2023-12-03 10:55:15,405 INFO [StoreOpener-236c5a2347aa1bfce918e0fb3cc51579-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 236c5a2347aa1bfce918e0fb3cc51579 columnFamilyName family1 2023-12-03 10:55:15,406 INFO [StoreOpener-236c5a2347aa1bfce918e0fb3cc51579-1] regionserver.HStore(310): Store=236c5a2347aa1bfce918e0fb3cc51579/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:15,406 INFO [StoreOpener-236c5a2347aa1bfce918e0fb3cc51579-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:15,407 DEBUG [StoreOpener-236c5a2347aa1bfce918e0fb3cc51579-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2 2023-12-03 10:55:15,407 DEBUG [StoreOpener-236c5a2347aa1bfce918e0fb3cc51579-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2 2023-12-03 10:55:15,408 INFO [StoreOpener-236c5a2347aa1bfce918e0fb3cc51579-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 236c5a2347aa1bfce918e0fb3cc51579 columnFamilyName family2 2023-12-03 10:55:15,409 INFO [StoreOpener-236c5a2347aa1bfce918e0fb3cc51579-1] regionserver.HStore(310): Store=236c5a2347aa1bfce918e0fb3cc51579/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:15,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:15,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:15,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:55:15,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:15,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:55:15,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 236c5a2347aa1bfce918e0fb3cc51579; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73735842, jitterRate=0.09874966740608215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:55:15,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:15,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579., pid=110, masterSystemTime=1701600915398 2023-12-03 10:55:15,428 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:55:15,428 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72d8df77 to 127.0.0.1:62442 2023-12-03 10:55:15,428 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:55:15,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:15,430 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:55:15,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:15,430 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a14a253 to 127.0.0.1:62442 2023-12-03 10:55:15,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:15,430 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:55:15,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8289e8e52c6c796e8f6a76e95ee71cf9, NAME => 'ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9.', STARTKEY => '1', ENDKEY => '2'} 2023-12-03 10:55:15,431 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=236c5a2347aa1bfce918e0fb3cc51579, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:15,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:15,431 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:55:15,431 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701600915431"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600915431"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600915431"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600915431"}]},"ts":"1701600915431"} 2023-12-03 10:55:15,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:15,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:15,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:15,431 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x209c1885 to 127.0.0.1:62442 2023-12-03 10:55:15,432 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:55:15,434 INFO [StoreOpener-8289e8e52c6c796e8f6a76e95ee71cf9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:15,436 DEBUG [StoreOpener-8289e8e52c6c796e8f6a76e95ee71cf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1 2023-12-03 10:55:15,436 DEBUG [StoreOpener-8289e8e52c6c796e8f6a76e95ee71cf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1 2023-12-03 10:55:15,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=110, resume processing ppid=106 2023-12-03 10:55:15,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 236c5a2347aa1bfce918e0fb3cc51579, server=jenkins-hbase4.apache.org,44259,1701600798821 in 186 msec 2023-12-03 10:55:15,436 INFO [StoreOpener-8289e8e52c6c796e8f6a76e95ee71cf9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8289e8e52c6c796e8f6a76e95ee71cf9 columnFamilyName family1 2023-12-03 10:55:15,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=236c5a2347aa1bfce918e0fb3cc51579, ASSIGN in 345 msec 2023-12-03 10:55:15,437 INFO [StoreOpener-8289e8e52c6c796e8f6a76e95ee71cf9-1] regionserver.HStore(310): Store=8289e8e52c6c796e8f6a76e95ee71cf9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:15,438 INFO [StoreOpener-8289e8e52c6c796e8f6a76e95ee71cf9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:15,439 DEBUG [StoreOpener-8289e8e52c6c796e8f6a76e95ee71cf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2 2023-12-03 10:55:15,439 DEBUG [StoreOpener-8289e8e52c6c796e8f6a76e95ee71cf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2 2023-12-03 10:55:15,439 INFO [StoreOpener-8289e8e52c6c796e8f6a76e95ee71cf9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8289e8e52c6c796e8f6a76e95ee71cf9 columnFamilyName family2 2023-12-03 10:55:15,440 INFO [StoreOpener-8289e8e52c6c796e8f6a76e95ee71cf9-1] regionserver.HStore(310): Store=8289e8e52c6c796e8f6a76e95ee71cf9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:15,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:15,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:15,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:55:15,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:15,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:55:15,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8289e8e52c6c796e8f6a76e95ee71cf9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61650407, jitterRate=-0.0813373476266861}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:55:15,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:15,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9., pid=111, masterSystemTime=1701600915398 2023-12-03 10:55:15,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:15,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:15,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:15,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6a2227d5c782c10299a2b96f43c845b4, NAME => 'ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4.', STARTKEY => '2', ENDKEY => ''} 2023-12-03 10:55:15,448 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8289e8e52c6c796e8f6a76e95ee71cf9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:15,448 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701600915448"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600915448"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600915448"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600915448"}]},"ts":"1701600915448"} 2023-12-03 10:55:15,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:15,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:15,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:15,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:15,449 INFO [StoreOpener-6a2227d5c782c10299a2b96f43c845b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:15,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=111, resume processing ppid=107 2023-12-03 10:55:15,450 DEBUG [StoreOpener-6a2227d5c782c10299a2b96f43c845b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1 2023-12-03 10:55:15,451 DEBUG [StoreOpener-6a2227d5c782c10299a2b96f43c845b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1 2023-12-03 10:55:15,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 8289e8e52c6c796e8f6a76e95ee71cf9, server=jenkins-hbase4.apache.org,44259,1701600798821 in 201 msec 2023-12-03 10:55:15,451 INFO [StoreOpener-6a2227d5c782c10299a2b96f43c845b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a2227d5c782c10299a2b96f43c845b4 columnFamilyName family1 2023-12-03 10:55:15,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8289e8e52c6c796e8f6a76e95ee71cf9, ASSIGN in 359 msec 2023-12-03 10:55:15,452 INFO [StoreOpener-6a2227d5c782c10299a2b96f43c845b4-1] regionserver.HStore(310): Store=6a2227d5c782c10299a2b96f43c845b4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:15,452 INFO [StoreOpener-6a2227d5c782c10299a2b96f43c845b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:15,453 DEBUG [StoreOpener-6a2227d5c782c10299a2b96f43c845b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2 2023-12-03 10:55:15,453 DEBUG [StoreOpener-6a2227d5c782c10299a2b96f43c845b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2 2023-12-03 10:55:15,454 INFO [StoreOpener-6a2227d5c782c10299a2b96f43c845b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a2227d5c782c10299a2b96f43c845b4 columnFamilyName family2 2023-12-03 10:55:15,454 INFO [StoreOpener-6a2227d5c782c10299a2b96f43c845b4-1] regionserver.HStore(310): Store=6a2227d5c782c10299a2b96f43c845b4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:15,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:15,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:15,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:55:15,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:15,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:55:15,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6a2227d5c782c10299a2b96f43c845b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73662346, jitterRate=0.09765449166297913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:55:15,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:15,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4., pid=109, masterSystemTime=1701600915398 2023-12-03 10:55:15,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:15,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:15,462 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=6a2227d5c782c10299a2b96f43c845b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:15,462 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701600915462"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600915462"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600915462"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600915462"}]},"ts":"1701600915462"} 2023-12-03 10:55:15,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=109, resume processing ppid=108 2023-12-03 10:55:15,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 6a2227d5c782c10299a2b96f43c845b4, server=jenkins-hbase4.apache.org,44259,1701600798821 in 216 msec 2023-12-03 10:55:15,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=108, resume processing ppid=105 2023-12-03 10:55:15,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=6a2227d5c782c10299a2b96f43c845b4, ASSIGN in 373 msec 2023-12-03 10:55:15,466 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:55:15,466 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600915466"}]},"ts":"1701600915466"} 2023-12-03 10:55:15,467 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-12-03 10:55:15,470 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:55:15,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2210 sec 2023-12-03 10:55:16,163 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/.tmp/family2/fb1ade433d3c4d3faea1f44343922bcd as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/fb1ade433d3c4d3faea1f44343922bcd 2023-12-03 10:55:16,167 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 4132a9cb8c9f3da44edb46b737bab3eb/family2 of 4132a9cb8c9f3da44edb46b737bab3eb into fb1ade433d3c4d3faea1f44343922bcd(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:16,168 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:55:16,168 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb., storeName=4132a9cb8c9f3da44edb46b737bab3eb/family2, priority=12, startTime=1701600913259; duration=0sec 2023-12-03 10:55:16,168 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-12-03 10:55:16,168 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-12-03 10:55:16,168 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-12-03 10:55:16,168 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-12-03 10:55:16,168 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. because compaction request was cancelled 2023-12-03 10:55:16,168 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-12-03 10:55:16,169 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-12-03 10:55:16,169 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-12-03 10:55:16,169 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. because compaction request was cancelled 2023-12-03 10:55:16,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-d529de4a505142ff8bd105432af5436a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-6c6974e9423f4bd9832f83c689cb3791, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-b115aaf2ec834a13a00f46dabf38ebcf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-2cc5a6f8db354cd8a7ae0ac3059a1832] to archive 2023-12-03 10:55:16,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:16,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-d529de4a505142ff8bd105432af5436a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-d529de4a505142ff8bd105432af5436a 2023-12-03 10:55:16,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-6c6974e9423f4bd9832f83c689cb3791 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-6c6974e9423f4bd9832f83c689cb3791 2023-12-03 10:55:16,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-b115aaf2ec834a13a00f46dabf38ebcf to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-b115aaf2ec834a13a00f46dabf38ebcf 2023-12-03 10:55:16,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-2cc5a6f8db354cd8a7ae0ac3059a1832 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/family2/testCompactionWithHFileLink=4132a9cb8c9f3da44edb46b737bab3eb-2cc5a6f8db354cd8a7ae0ac3059a1832 2023-12-03 10:55:16,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-12-03 10:55:16,358 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-12-03 10:55:16,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:16,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:16,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:16,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:16,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-12-03 10:55:16,372 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-12-03 10:55:16,372 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:16,372 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-12-03 10:55:16,372 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-12-03 10:55:16,373 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:16,373 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:16,374 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:16,375 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:16,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:16,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:16,375 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:16,375 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:16,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:16,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:16,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:16,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:16,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-12-03 10:55:16,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-12-03 10:55:16,376 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-12-03 10:55:16,376 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:16,376 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-12-03 10:55:16,380 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:16,380 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. started... 2023-12-03 10:55:16,380 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:16,382 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:16,382 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 236c5a2347aa1bfce918e0fb3cc51579 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-12-03 10:55:16,382 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:16,382 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:16,382 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. started... 2023-12-03 10:55:16,382 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. started... 2023-12-03 10:55:16,382 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8289e8e52c6c796e8f6a76e95ee71cf9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-12-03 10:55:16,382 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6a2227d5c782c10299a2b96f43c845b4 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-12-03 10:55:16,569 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/.tmp/family2/7547dc1c89274f0d996470fcf44aff7e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/7547dc1c89274f0d996470fcf44aff7e 2023-12-03 10:55:16,573 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 165139cb0d2367959816aa2994261e13/family2 of 165139cb0d2367959816aa2994261e13 into 7547dc1c89274f0d996470fcf44aff7e(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:16,573 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:55:16,573 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13., storeName=165139cb0d2367959816aa2994261e13/family2, priority=12, startTime=1701600913328; duration=1sec 2023-12-03 10:55:16,573 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:55:16,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-4f668439be874cd7b85324d646f88bcf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-38a7435be03a43f1a3d0d95e3b28cd49, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-7e7d2af92dfd467bb7a9fa912a9d7fd0, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-fe754da40a8e45f7bee253ee9b44b794] to archive 2023-12-03 10:55:16,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:16,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-4f668439be874cd7b85324d646f88bcf to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-4f668439be874cd7b85324d646f88bcf 2023-12-03 10:55:16,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-38a7435be03a43f1a3d0d95e3b28cd49 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-38a7435be03a43f1a3d0d95e3b28cd49 2023-12-03 10:55:16,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-7e7d2af92dfd467bb7a9fa912a9d7fd0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-7e7d2af92dfd467bb7a9fa912a9d7fd0 2023-12-03 10:55:16,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-fe754da40a8e45f7bee253ee9b44b794 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/family2/testCompactionWithHFileLink=165139cb0d2367959816aa2994261e13-fe754da40a8e45f7bee253ee9b44b794 2023-12-03 10:55:16,816 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203be3c0e6c06bc4a719e9e482c58ce95d4 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231203be3c0e6c06bc4a719e9e482c58ce95d4 2023-12-03 10:55:16,817 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023120349f99a507f814b4ead5a219714fa1388 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023120349f99a507f814b4ead5a219714fa1388 2023-12-03 10:55:16,824 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203c2987bf3aa4843a6b3a578d2e4960ab8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231203c2987bf3aa4843a6b3a578d2e4960ab8 2023-12-03 10:55:17,222 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/0f24fc7bdef94017956482e8ef5920c8 2023-12-03 10:55:17,222 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/6fbe3b51377c4251be258d944233afad 2023-12-03 10:55:17,229 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/0462361abd5643b48b0a803c906c819e 2023-12-03 10:55:17,242 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312034a326011d1ca4354b82516b49bec1bc0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202312034a326011d1ca4354b82516b49bec1bc0 2023-12-03 10:55:17,640 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203b7e7a1cf3f38484886864b8efb2f1e65 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231203b7e7a1cf3f38484886864b8efb2f1e65 2023-12-03 10:55:17,645 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/5f2c24200d01402080bd263260f9abb7 2023-12-03 10:55:17,647 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/91b37959940b4e7fb93fee54f81b0800 2023-12-03 10:55:17,648 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312031cd6d097981f43d88a35837262c27264 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202312031cd6d097981f43d88a35837262c27264 2023-12-03 10:55:17,649 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/0f24fc7bdef94017956482e8ef5920c8 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/0f24fc7bdef94017956482e8ef5920c8 2023-12-03 10:55:17,651 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/6fbe3b51377c4251be258d944233afad as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/6fbe3b51377c4251be258d944233afad 2023-12-03 10:55:17,653 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/0f24fc7bdef94017956482e8ef5920c8, entries=4, sequenceid=5, filesize=5.4 K 2023-12-03 10:55:17,654 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/5f2c24200d01402080bd263260f9abb7 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/5f2c24200d01402080bd263260f9abb7 2023-12-03 10:55:17,655 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/6fbe3b51377c4251be258d944233afad, entries=4, sequenceid=5, filesize=5.4 K 2023-12-03 10:55:17,655 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/91b37959940b4e7fb93fee54f81b0800 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/91b37959940b4e7fb93fee54f81b0800 2023-12-03 10:55:17,658 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/cfc115b49de14895a96e432b681557da 2023-12-03 10:55:17,658 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/5f2c24200d01402080bd263260f9abb7, entries=2, sequenceid=5, filesize=5.1 K 2023-12-03 10:55:17,659 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/91b37959940b4e7fb93fee54f81b0800, entries=2, sequenceid=5, filesize=5.1 K 2023-12-03 10:55:17,659 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6a2227d5c782c10299a2b96f43c845b4 in 1277ms, sequenceid=5, compaction requested=false 2023-12-03 10:55:17,659 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-12-03 10:55:17,660 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 236c5a2347aa1bfce918e0fb3cc51579 in 1278ms, sequenceid=5, compaction requested=false 2023-12-03 10:55:17,660 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:17,661 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:17,661 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:17,661 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:17,661 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:17,661 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:17,663 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/0462361abd5643b48b0a803c906c819e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/0462361abd5643b48b0a803c906c819e 2023-12-03 10:55:17,666 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/0462361abd5643b48b0a803c906c819e, entries=4, sequenceid=5, filesize=5.4 K 2023-12-03 10:55:17,666 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/cfc115b49de14895a96e432b681557da as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/cfc115b49de14895a96e432b681557da 2023-12-03 10:55:17,669 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/cfc115b49de14895a96e432b681557da, entries=2, sequenceid=5, filesize=5.1 K 2023-12-03 10:55:17,669 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8289e8e52c6c796e8f6a76e95ee71cf9 in 1287ms, sequenceid=5, compaction requested=false 2023-12-03 10:55:17,669 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:17,669 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:17,669 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-12-03 10:55:17,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-12-03 10:55:17,672 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:17,672 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:17,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:17,672 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:17,672 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:17,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:17,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:17,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:17,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:17,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-12-03 10:55:17,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e39109[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:17,673 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-12-03 10:55:17,674 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:17,675 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:17,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:17,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:17,675 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-12-03 10:55:17,675 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-12-03 10:55:17,675 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:17,675 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,675 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:17,678 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-12-03 10:55:17,678 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:17,678 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,678 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-12-03 10:55:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:17,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-12-03 10:55:17,680 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-12-03 10:55:17,680 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:17,680 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:17,680 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-12-03 10:55:17,680 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:17,682 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:17,682 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:17,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:17,682 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:17,682 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:17,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,683 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-12-03 10:55:17,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-12-03 10:55:17,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:17,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:17,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:17,686 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:17,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:17,686 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:17,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:17,786 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:17,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:17,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:17,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:17,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:17,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:17,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:17,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-12-03 10:55:17,793 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-12-03 10:55:17,793 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:17,793 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-12-03 10:55:17,793 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-12-03 10:55:17,793 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:17,794 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:17,795 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,795 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:17,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:17,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:17,795 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:17,795 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:17,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:17,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:17,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:17,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:17,796 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-12-03 10:55:17,797 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-12-03 10:55:17,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-12-03 10:55:17,797 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-12-03 10:55:17,797 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:17,797 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-12-03 10:55:17,797 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:17,797 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. started... 2023-12-03 10:55:17,797 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 236c5a2347aa1bfce918e0fb3cc51579 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-12-03 10:55:17,800 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:17,800 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. started... 2023-12-03 10:55:17,800 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:17,800 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:17,800 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:17,800 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. started... 2023-12-03 10:55:17,800 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8289e8e52c6c796e8f6a76e95ee71cf9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-12-03 10:55:17,801 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6a2227d5c782c10299a2b96f43c845b4 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-12-03 10:55:18,232 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203e6ec6ecdaca0495794fad957b6660edd to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231203e6ec6ecdaca0495794fad957b6660edd 2023-12-03 10:55:18,234 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203e94d1ffc89bd431f8a9f91ef688ed578 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231203e94d1ffc89bd431f8a9f91ef688ed578 2023-12-03 10:55:18,236 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203db1143a85d904e6197f5e977004e86f5 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231203db1143a85d904e6197f5e977004e86f5 2023-12-03 10:55:18,256 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/5e8c7b2d3191469485f6a83afbaf10f8 2023-12-03 10:55:18,258 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/d44ce003f193468b8f8cd362e2e76b36 2023-12-03 10:55:18,260 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/bbfc109dee36448fb52aad76eeb53bb3 2023-12-03 10:55:18,312 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203ac7c1b065fe24ad4afdd73ee0145a9c3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231203ac7c1b065fe24ad4afdd73ee0145a9c3 2023-12-03 10:55:18,706 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312033dd1ce2452954fca93c7d7838ca9c38b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202312033dd1ce2452954fca93c7d7838ca9c38b 2023-12-03 10:55:18,710 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203151d05c881134d75befb2c696c8cab9c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231203151d05c881134d75befb2c696c8cab9c 2023-12-03 10:55:18,717 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/7a21951768594d2084feb22aed225793 2023-12-03 10:55:18,719 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/ccafe906267b469da3dac52782013394 2023-12-03 10:55:18,722 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/bbfc109dee36448fb52aad76eeb53bb3 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/bbfc109dee36448fb52aad76eeb53bb3 2023-12-03 10:55:18,724 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/d44ce003f193468b8f8cd362e2e76b36 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/d44ce003f193468b8f8cd362e2e76b36 2023-12-03 10:55:18,726 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/bbfc109dee36448fb52aad76eeb53bb3, entries=4, sequenceid=9, filesize=5.4 K 2023-12-03 10:55:18,727 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/7a21951768594d2084feb22aed225793 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/7a21951768594d2084feb22aed225793 2023-12-03 10:55:18,730 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/d44ce003f193468b8f8cd362e2e76b36, entries=4, sequenceid=9, filesize=5.4 K 2023-12-03 10:55:18,731 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/ccafe906267b469da3dac52782013394 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/ccafe906267b469da3dac52782013394 2023-12-03 10:55:18,732 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/7a21951768594d2084feb22aed225793, entries=2, sequenceid=9, filesize=5.1 K 2023-12-03 10:55:18,733 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 236c5a2347aa1bfce918e0fb3cc51579 in 936ms, sequenceid=9, compaction requested=false 2023-12-03 10:55:18,733 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:18,733 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:18,733 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:18,736 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/ccafe906267b469da3dac52782013394, entries=2, sequenceid=9, filesize=5.1 K 2023-12-03 10:55:18,737 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8289e8e52c6c796e8f6a76e95ee71cf9 in 937ms, sequenceid=9, compaction requested=false 2023-12-03 10:55:18,737 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:18,737 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:18,737 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:19,113 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/54bd4f252faf4f619c15ad21ec9e56da 2023-12-03 10:55:19,119 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/5e8c7b2d3191469485f6a83afbaf10f8 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5e8c7b2d3191469485f6a83afbaf10f8 2023-12-03 10:55:19,122 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5e8c7b2d3191469485f6a83afbaf10f8, entries=4, sequenceid=9, filesize=5.4 K 2023-12-03 10:55:19,123 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/54bd4f252faf4f619c15ad21ec9e56da as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/54bd4f252faf4f619c15ad21ec9e56da 2023-12-03 10:55:19,126 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/54bd4f252faf4f619c15ad21ec9e56da, entries=2, sequenceid=9, filesize=5.1 K 2023-12-03 10:55:19,127 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6a2227d5c782c10299a2b96f43c845b4 in 1326ms, sequenceid=9, compaction requested=false 2023-12-03 10:55:19,127 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:19,127 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:19,127 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:19,127 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:19,127 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,127 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-12-03 10:55:19,127 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-12-03 10:55:19,129 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,129 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:19,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:19,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:19,129 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:19,130 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:19,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:19,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:19,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:19,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:19,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-12-03 10:55:19,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20ad2207[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:19,131 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-12-03 10:55:19,131 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:19,132 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:19,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:19,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:19,132 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-12-03 10:55:19,132 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-12-03 10:55:19,132 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:19,133 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,133 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:19,134 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-12-03 10:55:19,134 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,134 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:19,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:19,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:19,134 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-12-03 10:55:19,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:19,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-12-03 10:55:19,137 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-12-03 10:55:19,137 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:19,137 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:19,137 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-12-03 10:55:19,137 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:19,140 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:19,140 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:19,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:19,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:19,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:19,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:19,140 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:19,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:19,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:19,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:19,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:19,141 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:19,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:19,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:19,142 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:19,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:19,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,145 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:19,145 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:19,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:19,145 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:19,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-12-03 10:55:19,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:19,146 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:19,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:19,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:19,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-12-03 10:55:19,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:19,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:19,146 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:19,146 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:19,146 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:19,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:19,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:19,246 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:19,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:19,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:19,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:19,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:19,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:19,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:19,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-12-03 10:55:19,252 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-12-03 10:55:19,253 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:19,253 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-12-03 10:55:19,253 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-12-03 10:55:19,253 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:19,253 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:19,255 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:19,255 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:19,255 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:19,255 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:19,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:19,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:19,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:19,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-12-03 10:55:19,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-12-03 10:55:19,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-12-03 10:55:19,256 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-12-03 10:55:19,256 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:19,256 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-12-03 10:55:19,257 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:19,257 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. started... 2023-12-03 10:55:19,257 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 236c5a2347aa1bfce918e0fb3cc51579 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-12-03 10:55:19,257 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:19,257 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. started... 2023-12-03 10:55:19,257 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8289e8e52c6c796e8f6a76e95ee71cf9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-12-03 10:55:19,257 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:19,258 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:19,258 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:19,258 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. started... 2023-12-03 10:55:19,258 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6a2227d5c782c10299a2b96f43c845b4 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-12-03 10:55:19,284 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203207b9654f16f4ed5bf41cec9cba5af15 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231203207b9654f16f4ed5bf41cec9cba5af15 2023-12-03 10:55:19,286 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023120318da6b6da12441369d4fcf29f25de437 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023120318da6b6da12441369d4fcf29f25de437 2023-12-03 10:55:19,296 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/37dd737308ce4dbba945ff6f20e3a85b 2023-12-03 10:55:19,315 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023120383d0ae4feba34034a2b5e85b4ff7cc8b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023120383d0ae4feba34034a2b5e85b4ff7cc8b 2023-12-03 10:55:19,681 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312032416c6f9e2264a679bf6ac28fd69b511 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202312032416c6f9e2264a679bf6ac28fd69b511 2023-12-03 10:55:19,706 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/85769646227e4bbb9dab49c33bf1762c 2023-12-03 10:55:19,720 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/7fce0ae5a5e44df5a2d4594a655ec763 2023-12-03 10:55:19,724 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312039b2399b39a3f4b17b910282860ee8b0a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202312039b2399b39a3f4b17b910282860ee8b0a 2023-12-03 10:55:19,725 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/37dd737308ce4dbba945ff6f20e3a85b as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/37dd737308ce4dbba945ff6f20e3a85b 2023-12-03 10:55:19,729 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/37dd737308ce4dbba945ff6f20e3a85b, entries=4, sequenceid=13, filesize=5.4 K 2023-12-03 10:55:19,730 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/7fce0ae5a5e44df5a2d4594a655ec763 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/7fce0ae5a5e44df5a2d4594a655ec763 2023-12-03 10:55:19,734 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/7fce0ae5a5e44df5a2d4594a655ec763, entries=2, sequenceid=13, filesize=5.1 K 2023-12-03 10:55:19,735 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8289e8e52c6c796e8f6a76e95ee71cf9 in 478ms, sequenceid=13, compaction requested=true 2023-12-03 10:55:19,735 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:19,735 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:19,735 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:20,095 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/e4fb096a13974d61a781ae06b0e51165 2023-12-03 10:55:20,130 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/beba55617d194c7eba75590bd0211810 2023-12-03 10:55:20,135 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/85769646227e4bbb9dab49c33bf1762c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/85769646227e4bbb9dab49c33bf1762c 2023-12-03 10:55:20,138 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/85769646227e4bbb9dab49c33bf1762c, entries=4, sequenceid=13, filesize=5.4 K 2023-12-03 10:55:20,139 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/beba55617d194c7eba75590bd0211810 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/beba55617d194c7eba75590bd0211810 2023-12-03 10:55:20,142 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/beba55617d194c7eba75590bd0211810, entries=2, sequenceid=13, filesize=5.1 K 2023-12-03 10:55:20,143 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6a2227d5c782c10299a2b96f43c845b4 in 885ms, sequenceid=13, compaction requested=true 2023-12-03 10:55:20,143 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:20,143 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:20,143 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:20,234 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-12-03 10:55:20,517 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312036724e9437a9f439a9dd7836348dd3c28 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202312036724e9437a9f439a9dd7836348dd3c28 2023-12-03 10:55:20,903 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:55:20,922 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/1abb41b14ede42a2b8a51dcaadc75455 2023-12-03 10:55:20,926 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/e4fb096a13974d61a781ae06b0e51165 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/e4fb096a13974d61a781ae06b0e51165 2023-12-03 10:55:20,930 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/e4fb096a13974d61a781ae06b0e51165, entries=4, sequenceid=13, filesize=5.4 K 2023-12-03 10:55:20,931 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/1abb41b14ede42a2b8a51dcaadc75455 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/1abb41b14ede42a2b8a51dcaadc75455 2023-12-03 10:55:20,935 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/1abb41b14ede42a2b8a51dcaadc75455, entries=2, sequenceid=13, filesize=5.1 K 2023-12-03 10:55:20,936 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 236c5a2347aa1bfce918e0fb3cc51579 in 1679ms, sequenceid=13, compaction requested=true 2023-12-03 10:55:20,936 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:20,936 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:20,936 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:20,936 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:20,936 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,936 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-12-03 10:55:20,936 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-12-03 10:55:20,938 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,938 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:20,939 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:20,939 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:20,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-12-03 10:55:20,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@437be9cd[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:20,940 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-12-03 10:55:20,940 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:20,942 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:20,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:20,943 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-12-03 10:55:20,943 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-12-03 10:55:20,943 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:20,943 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,943 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:20,944 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-12-03 10:55:20,944 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:20,944 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,944 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-12-03 10:55:20,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:20,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-12-03 10:55:20,947 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-12-03 10:55:20,947 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:20,947 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:20,947 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-12-03 10:55:20,947 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:20,952 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:20,952 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:20,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:20,952 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:20,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:20,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:20,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:20,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:20,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:20,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:20,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:20,953 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:20,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:20,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:20,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:20,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,954 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:20,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:20,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:20,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:20,957 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:20,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-12-03 10:55:20,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:20,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:20,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:20,957 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:21,057 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:21,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:21,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:21,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:21,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:21,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:21,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:21,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-12-03 10:55:21,064 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-12-03 10:55:21,064 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:21,064 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-12-03 10:55:21,064 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-12-03 10:55:21,064 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:21,064 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:21,066 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:21,066 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:21,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:21,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:21,066 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:21,066 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:21,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:21,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:21,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:21,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:21,067 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-12-03 10:55:21,067 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-12-03 10:55:21,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-12-03 10:55:21,067 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-12-03 10:55:21,067 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:21,067 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-12-03 10:55:21,068 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:21,068 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. started... 2023-12-03 10:55:21,068 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:21,068 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. started... 2023-12-03 10:55:21,068 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 236c5a2347aa1bfce918e0fb3cc51579 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-12-03 10:55:21,068 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8289e8e52c6c796e8f6a76e95ee71cf9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-12-03 10:55:21,068 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:21,068 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:21,068 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:21,068 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. started... 2023-12-03 10:55:21,068 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6a2227d5c782c10299a2b96f43c845b4 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-12-03 10:55:21,085 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312036e5b98ce63354466bb1419b87d031b95 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202312036e5b98ce63354466bb1419b87d031b95 2023-12-03 10:55:21,089 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/86a1bf8afd174cb783d5c457a52e25b2 2023-12-03 10:55:21,483 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312034407254e0a6e4850b1e56640664a9449 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202312034407254e0a6e4850b1e56640664a9449 2023-12-03 10:55:21,484 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203f41677f24b9045349e1dfa2c2b35ba87 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231203f41677f24b9045349e1dfa2c2b35ba87 2023-12-03 10:55:21,499 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203afb0bed887344b98accbcb9963a99790 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231203afb0bed887344b98accbcb9963a99790 2023-12-03 10:55:21,888 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/5494f9f22d254c63bb6d984e3e81fe61 2023-12-03 10:55:21,888 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/31098948d1404099b0ab430d131828d5 2023-12-03 10:55:21,903 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/8fd3c43333824a88be0929139beb83bc 2023-12-03 10:55:21,907 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/86a1bf8afd174cb783d5c457a52e25b2 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/86a1bf8afd174cb783d5c457a52e25b2 2023-12-03 10:55:21,910 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/86a1bf8afd174cb783d5c457a52e25b2, entries=4, sequenceid=17, filesize=5.4 K 2023-12-03 10:55:21,910 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/8fd3c43333824a88be0929139beb83bc as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/8fd3c43333824a88be0929139beb83bc 2023-12-03 10:55:21,913 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/8fd3c43333824a88be0929139beb83bc, entries=2, sequenceid=17, filesize=5.1 K 2023-12-03 10:55:21,914 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 236c5a2347aa1bfce918e0fb3cc51579 in 846ms, sequenceid=17, compaction requested=true 2023-12-03 10:55:21,914 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:21,914 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:21,914 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:22,302 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312030c1725f7ff924a34b50938a2f4511d7a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202312030c1725f7ff924a34b50938a2f4511d7a 2023-12-03 10:55:22,302 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203571a779c2db94698ad47b0c0c2823ddd to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231203571a779c2db94698ad47b0c0c2823ddd 2023-12-03 10:55:22,708 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/4608ed7a77fd4b74b22a8a68c8e2092e 2023-12-03 10:55:22,708 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/f853b8683b284db1970255ec40d7646c 2023-12-03 10:55:22,712 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/31098948d1404099b0ab430d131828d5 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/31098948d1404099b0ab430d131828d5 2023-12-03 10:55:22,712 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/5494f9f22d254c63bb6d984e3e81fe61 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5494f9f22d254c63bb6d984e3e81fe61 2023-12-03 10:55:22,716 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5494f9f22d254c63bb6d984e3e81fe61, entries=4, sequenceid=17, filesize=5.4 K 2023-12-03 10:55:22,716 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/31098948d1404099b0ab430d131828d5, entries=4, sequenceid=17, filesize=5.4 K 2023-12-03 10:55:22,716 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/f853b8683b284db1970255ec40d7646c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/f853b8683b284db1970255ec40d7646c 2023-12-03 10:55:22,716 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/4608ed7a77fd4b74b22a8a68c8e2092e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/4608ed7a77fd4b74b22a8a68c8e2092e 2023-12-03 10:55:22,721 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/4608ed7a77fd4b74b22a8a68c8e2092e, entries=2, sequenceid=17, filesize=5.1 K 2023-12-03 10:55:22,721 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/f853b8683b284db1970255ec40d7646c, entries=2, sequenceid=17, filesize=5.1 K 2023-12-03 10:55:22,722 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8289e8e52c6c796e8f6a76e95ee71cf9 in 1654ms, sequenceid=17, compaction requested=true 2023-12-03 10:55:22,722 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6a2227d5c782c10299a2b96f43c845b4 in 1654ms, sequenceid=17, compaction requested=true 2023-12-03 10:55:22,722 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:22,722 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:22,722 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:22,722 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:22,722 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:22,722 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:22,722 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:22,723 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,723 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-12-03 10:55:22,723 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-12-03 10:55:22,725 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,725 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:22,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:22,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:22,725 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:22,725 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:22,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:22,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:22,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:22,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:22,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-12-03 10:55:22,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771dc21b[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:22,727 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-12-03 10:55:22,727 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:22,728 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:22,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:22,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:22,728 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-12-03 10:55:22,728 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-12-03 10:55:22,728 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:22,728 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,728 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:22,729 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,729 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-12-03 10:55:22,729 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:22,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:22,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:22,729 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-12-03 10:55:22,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:22,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:22,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:22,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:22,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:22,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:22,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-12-03 10:55:22,732 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-12-03 10:55:22,732 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:22,732 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:22,732 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-12-03 10:55:22,732 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:22,736 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:22,736 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:22,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:22,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:22,737 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:22,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:22,737 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:22,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:22,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:22,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:22,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,739 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:22,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:22,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:22,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:22,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:22,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:22,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-12-03 10:55:22,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:22,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:22,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:22,741 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:22,741 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:22,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:22,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-12-03 10:55:22,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:22,741 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:22,742 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:22,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:22,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:22,842 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:22,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:22,851 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:22,859 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:22,869 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:22,870 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:22,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:22,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:22,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-12-03 10:55:22,899 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-12-03 10:55:22,899 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:22,899 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-12-03 10:55:22,899 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-12-03 10:55:22,900 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:22,900 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:22,901 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,901 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:22,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:22,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:22,902 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:22,902 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:22,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:22,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:22,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:22,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:22,903 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-12-03 10:55:22,903 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-12-03 10:55:22,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-12-03 10:55:22,903 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-12-03 10:55:22,903 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:22,903 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-12-03 10:55:22,903 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:22,903 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. started... 2023-12-03 10:55:22,903 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:22,903 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:22,903 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:22,903 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. started... 2023-12-03 10:55:22,903 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 236c5a2347aa1bfce918e0fb3cc51579 2/2 column families, dataSize=138 B heapSize=944 B 2023-12-03 10:55:22,904 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8289e8e52c6c796e8f6a76e95ee71cf9 2/2 column families, dataSize=138 B heapSize=944 B 2023-12-03 10:55:22,903 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. started... 2023-12-03 10:55:22,903 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:22,904 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6a2227d5c782c10299a2b96f43c845b4 2/2 column families, dataSize=138 B heapSize=944 B 2023-12-03 10:55:22,919 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/293d3e22d1c8490084ff38b9a3e5c788 2023-12-03 10:55:22,922 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 293d3e22d1c8490084ff38b9a3e5c788 2023-12-03 10:55:23,319 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/2817bf7d1b0c437fa8d9d998eaeb231f 2023-12-03 10:55:23,323 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2817bf7d1b0c437fa8d9d998eaeb231f 2023-12-03 10:55:23,345 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/1179120cae014b1bb894a8920b8aacbc 2023-12-03 10:55:23,348 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1179120cae014b1bb894a8920b8aacbc 2023-12-03 10:55:23,349 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/293d3e22d1c8490084ff38b9a3e5c788 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/293d3e22d1c8490084ff38b9a3e5c788 2023-12-03 10:55:23,353 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 293d3e22d1c8490084ff38b9a3e5c788 2023-12-03 10:55:23,353 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/293d3e22d1c8490084ff38b9a3e5c788, entries=3, sequenceid=23, filesize=5.0 K 2023-12-03 10:55:23,354 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/1179120cae014b1bb894a8920b8aacbc as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/1179120cae014b1bb894a8920b8aacbc 2023-12-03 10:55:23,358 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1179120cae014b1bb894a8920b8aacbc 2023-12-03 10:55:23,358 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/1179120cae014b1bb894a8920b8aacbc, entries=1, sequenceid=23, filesize=5.0 K 2023-12-03 10:55:23,359 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8289e8e52c6c796e8f6a76e95ee71cf9 in 455ms, sequenceid=23, compaction requested=true 2023-12-03 10:55:23,359 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:23,359 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:23,359 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:23,719 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/3363f8bd6f934066b3599c73f3f66f44 2023-12-03 10:55:23,723 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3363f8bd6f934066b3599c73f3f66f44 2023-12-03 10:55:23,743 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/1f71f1cf09f74160a59056ab53871c8e 2023-12-03 10:55:23,747 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f71f1cf09f74160a59056ab53871c8e 2023-12-03 10:55:23,748 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/2817bf7d1b0c437fa8d9d998eaeb231f as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/2817bf7d1b0c437fa8d9d998eaeb231f 2023-12-03 10:55:23,752 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2817bf7d1b0c437fa8d9d998eaeb231f 2023-12-03 10:55:23,752 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/2817bf7d1b0c437fa8d9d998eaeb231f, entries=3, sequenceid=23, filesize=5.0 K 2023-12-03 10:55:23,752 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/1f71f1cf09f74160a59056ab53871c8e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/1f71f1cf09f74160a59056ab53871c8e 2023-12-03 10:55:23,756 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f71f1cf09f74160a59056ab53871c8e 2023-12-03 10:55:23,756 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/1f71f1cf09f74160a59056ab53871c8e, entries=1, sequenceid=23, filesize=5.0 K 2023-12-03 10:55:23,759 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6a2227d5c782c10299a2b96f43c845b4 in 855ms, sequenceid=23, compaction requested=true 2023-12-03 10:55:23,759 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:23,759 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:23,759 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:24,136 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/f0d9b5428eba4e3490a5aa589d2bf48a 2023-12-03 10:55:24,140 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0d9b5428eba4e3490a5aa589d2bf48a 2023-12-03 10:55:24,141 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/3363f8bd6f934066b3599c73f3f66f44 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/3363f8bd6f934066b3599c73f3f66f44 2023-12-03 10:55:24,144 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3363f8bd6f934066b3599c73f3f66f44 2023-12-03 10:55:24,144 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/3363f8bd6f934066b3599c73f3f66f44, entries=3, sequenceid=23, filesize=5.0 K 2023-12-03 10:55:24,145 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/f0d9b5428eba4e3490a5aa589d2bf48a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/f0d9b5428eba4e3490a5aa589d2bf48a 2023-12-03 10:55:24,149 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0d9b5428eba4e3490a5aa589d2bf48a 2023-12-03 10:55:24,149 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/f0d9b5428eba4e3490a5aa589d2bf48a, entries=1, sequenceid=23, filesize=5.0 K 2023-12-03 10:55:24,150 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 236c5a2347aa1bfce918e0fb3cc51579 in 1247ms, sequenceid=23, compaction requested=true 2023-12-03 10:55:24,150 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:24,150 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:24,150 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:24,150 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:24,150 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,150 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-12-03 10:55:24,150 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-12-03 10:55:24,152 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,152 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:24,153 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:24,153 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:24,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:24,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:24,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:24,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:24,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-12-03 10:55:24,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28a97e28[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:24,154 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-12-03 10:55:24,154 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:24,156 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:24,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:24,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:24,156 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-12-03 10:55:24,156 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-12-03 10:55:24,156 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:24,156 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,156 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:24,157 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-12-03 10:55:24,157 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,158 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:24,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:24,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:24,158 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-12-03 10:55:24,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:24,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:24,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:24,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-12-03 10:55:24,161 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-12-03 10:55:24,161 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:24,161 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:24,161 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-12-03 10:55:24,161 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:24,163 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:24,163 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:24,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:24,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:24,163 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:24,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:24,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:24,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:24,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:24,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:24,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:24,164 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:24,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:24,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:24,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:24,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,165 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:24,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-12-03 10:55:24,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,167 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,167 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:24,167 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:24,167 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-12-03 10:55:24,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:24,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-12-03 10:55:24,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:24,167 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:24,167 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:24,167 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:24,168 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:24,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:24,168 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-12-03 10:55:24,168 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:24,168 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-12-03 10:55:24,168 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:24,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:24,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:24,268 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:24,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:24,269 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:24,269 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 236c5a2347aa1bfce918e0fb3cc51579/family1 is initiating major compaction (all files) 2023-12-03 10:55:24,269 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:24,269 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:24,269 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 236c5a2347aa1bfce918e0fb3cc51579/family1 in ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:24,270 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/6fbe3b51377c4251be258d944233afad, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/bbfc109dee36448fb52aad76eeb53bb3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/e4fb096a13974d61a781ae06b0e51165, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/86a1bf8afd174cb783d5c457a52e25b2, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/3363f8bd6f934066b3599c73f3f66f44] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp, totalSize=26.6 K 2023-12-03 10:55:24,270 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 6fbe3b51377c4251be258d944233afad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600916365 2023-12-03 10:55:24,270 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting bbfc109dee36448fb52aad76eeb53bb3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600917788 2023-12-03 10:55:24,271 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting e4fb096a13974d61a781ae06b0e51165, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600919248 2023-12-03 10:55:24,271 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 86a1bf8afd174cb783d5c457a52e25b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600921060 2023-12-03 10:55:24,271 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 3363f8bd6f934066b3599c73f3f66f44, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:24,281 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 236c5a2347aa1bfce918e0fb3cc51579#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:24,288 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231203cec856858a564de5a94b9d1a78af5b3c_del 2023-12-03 10:55:24,288 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203cec856858a564de5a94b9d1a78af5b3c_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231203cec856858a564de5a94b9d1a78af5b3c_del 2023-12-03 10:55:25,101 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cffac28d68114e69b5cb9b71f92f3400 2023-12-03 10:55:25,101 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family1/cffac28d68114e69b5cb9b71f92f3400 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/cffac28d68114e69b5cb9b71f92f3400 2023-12-03 10:55:25,105 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cffac28d68114e69b5cb9b71f92f3400 2023-12-03 10:55:25,106 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 236c5a2347aa1bfce918e0fb3cc51579/family1 of 236c5a2347aa1bfce918e0fb3cc51579 into cffac28d68114e69b5cb9b71f92f3400(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:25,106 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:25,106 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:25,106 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 236c5a2347aa1bfce918e0fb3cc51579/family2 is initiating major compaction (all files) 2023-12-03 10:55:25,106 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:25,106 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:25,106 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 236c5a2347aa1bfce918e0fb3cc51579/family2 in ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:25,106 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/91b37959940b4e7fb93fee54f81b0800, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/7a21951768594d2084feb22aed225793, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/1abb41b14ede42a2b8a51dcaadc75455, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/8fd3c43333824a88be0929139beb83bc, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/f0d9b5428eba4e3490a5aa589d2bf48a] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp, totalSize=25.3 K 2023-12-03 10:55:25,107 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 91b37959940b4e7fb93fee54f81b0800, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600916365 2023-12-03 10:55:25,107 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 7a21951768594d2084feb22aed225793, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600917788 2023-12-03 10:55:25,107 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 1abb41b14ede42a2b8a51dcaadc75455, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600919248 2023-12-03 10:55:25,108 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 8fd3c43333824a88be0929139beb83bc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600921060 2023-12-03 10:55:25,108 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting f0d9b5428eba4e3490a5aa589d2bf48a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:25,116 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 236c5a2347aa1bfce918e0fb3cc51579#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:25,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/6fbe3b51377c4251be258d944233afad, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/bbfc109dee36448fb52aad76eeb53bb3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/e4fb096a13974d61a781ae06b0e51165, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/86a1bf8afd174cb783d5c457a52e25b2, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/3363f8bd6f934066b3599c73f3f66f44] to archive 2023-12-03 10:55:25,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:25,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/6fbe3b51377c4251be258d944233afad to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/6fbe3b51377c4251be258d944233afad 2023-12-03 10:55:25,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/bbfc109dee36448fb52aad76eeb53bb3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/bbfc109dee36448fb52aad76eeb53bb3 2023-12-03 10:55:25,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/e4fb096a13974d61a781ae06b0e51165 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/e4fb096a13974d61a781ae06b0e51165 2023-12-03 10:55:25,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/86a1bf8afd174cb783d5c457a52e25b2 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/86a1bf8afd174cb783d5c457a52e25b2 2023-12-03 10:55:25,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/3363f8bd6f934066b3599c73f3f66f44 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/3363f8bd6f934066b3599c73f3f66f44 2023-12-03 10:55:25,524 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202312036a0ccef629fa45f4b68611f9ac048a80_del 2023-12-03 10:55:25,524 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312036a0ccef629fa45f4b68611f9ac048a80_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202312036a0ccef629fa45f4b68611f9ac048a80_del 2023-12-03 10:55:26,337 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47b8249fc39c4f98bbdea1204ca0ea8a 2023-12-03 10:55:26,337 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/.tmp/family2/47b8249fc39c4f98bbdea1204ca0ea8a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/47b8249fc39c4f98bbdea1204ca0ea8a 2023-12-03 10:55:26,341 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47b8249fc39c4f98bbdea1204ca0ea8a 2023-12-03 10:55:26,342 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 236c5a2347aa1bfce918e0fb3cc51579/family2 of 236c5a2347aa1bfce918e0fb3cc51579 into 47b8249fc39c4f98bbdea1204ca0ea8a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:26,342 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:26,342 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:26,343 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 8289e8e52c6c796e8f6a76e95ee71cf9/family1 is initiating major compaction (all files) 2023-12-03 10:55:26,343 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:26,343 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:26,344 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 8289e8e52c6c796e8f6a76e95ee71cf9/family1 in ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:26,344 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/0462361abd5643b48b0a803c906c819e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/d44ce003f193468b8f8cd362e2e76b36, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/37dd737308ce4dbba945ff6f20e3a85b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/31098948d1404099b0ab430d131828d5, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/293d3e22d1c8490084ff38b9a3e5c788] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp, totalSize=26.6 K 2023-12-03 10:55:26,344 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 0462361abd5643b48b0a803c906c819e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600916365 2023-12-03 10:55:26,345 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting d44ce003f193468b8f8cd362e2e76b36, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600917789 2023-12-03 10:55:26,345 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 37dd737308ce4dbba945ff6f20e3a85b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600919249 2023-12-03 10:55:26,345 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 31098948d1404099b0ab430d131828d5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600921060 2023-12-03 10:55:26,346 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 293d3e22d1c8490084ff38b9a3e5c788, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:26,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/91b37959940b4e7fb93fee54f81b0800, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/7a21951768594d2084feb22aed225793, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/1abb41b14ede42a2b8a51dcaadc75455, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/8fd3c43333824a88be0929139beb83bc, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/f0d9b5428eba4e3490a5aa589d2bf48a] to archive 2023-12-03 10:55:26,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:26,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/91b37959940b4e7fb93fee54f81b0800 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/91b37959940b4e7fb93fee54f81b0800 2023-12-03 10:55:26,355 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 8289e8e52c6c796e8f6a76e95ee71cf9#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:26,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/7a21951768594d2084feb22aed225793 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/7a21951768594d2084feb22aed225793 2023-12-03 10:55:26,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/1abb41b14ede42a2b8a51dcaadc75455 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/1abb41b14ede42a2b8a51dcaadc75455 2023-12-03 10:55:26,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/8fd3c43333824a88be0929139beb83bc to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/8fd3c43333824a88be0929139beb83bc 2023-12-03 10:55:26,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/f0d9b5428eba4e3490a5aa589d2bf48a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family2/f0d9b5428eba4e3490a5aa589d2bf48a 2023-12-03 10:55:26,364 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023120363abea350c39423b9da39454b1dcf076_del 2023-12-03 10:55:26,364 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023120363abea350c39423b9da39454b1dcf076_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023120363abea350c39423b9da39454b1dcf076_del 2023-12-03 10:55:27,183 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7bc8e5efd3164d3cbb71d551975469fd 2023-12-03 10:55:27,183 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family1/7bc8e5efd3164d3cbb71d551975469fd as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/7bc8e5efd3164d3cbb71d551975469fd 2023-12-03 10:55:27,187 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7bc8e5efd3164d3cbb71d551975469fd 2023-12-03 10:55:27,188 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8289e8e52c6c796e8f6a76e95ee71cf9/family1 of 8289e8e52c6c796e8f6a76e95ee71cf9 into 7bc8e5efd3164d3cbb71d551975469fd(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:27,188 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:27,188 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:27,188 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 8289e8e52c6c796e8f6a76e95ee71cf9/family2 is initiating major compaction (all files) 2023-12-03 10:55:27,188 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:27,188 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:27,188 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 8289e8e52c6c796e8f6a76e95ee71cf9/family2 in ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:27,189 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/cfc115b49de14895a96e432b681557da, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/ccafe906267b469da3dac52782013394, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/7fce0ae5a5e44df5a2d4594a655ec763, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/4608ed7a77fd4b74b22a8a68c8e2092e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/1179120cae014b1bb894a8920b8aacbc] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp, totalSize=25.3 K 2023-12-03 10:55:27,189 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting cfc115b49de14895a96e432b681557da, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600916365 2023-12-03 10:55:27,189 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting ccafe906267b469da3dac52782013394, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600917789 2023-12-03 10:55:27,190 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 7fce0ae5a5e44df5a2d4594a655ec763, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600919249 2023-12-03 10:55:27,190 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 4608ed7a77fd4b74b22a8a68c8e2092e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600921060 2023-12-03 10:55:27,190 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 1179120cae014b1bb894a8920b8aacbc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:27,199 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 8289e8e52c6c796e8f6a76e95ee71cf9#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:27,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/0462361abd5643b48b0a803c906c819e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/d44ce003f193468b8f8cd362e2e76b36, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/37dd737308ce4dbba945ff6f20e3a85b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/31098948d1404099b0ab430d131828d5, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/293d3e22d1c8490084ff38b9a3e5c788] to archive 2023-12-03 10:55:27,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:27,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/0462361abd5643b48b0a803c906c819e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/0462361abd5643b48b0a803c906c819e 2023-12-03 10:55:27,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/d44ce003f193468b8f8cd362e2e76b36 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/d44ce003f193468b8f8cd362e2e76b36 2023-12-03 10:55:27,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/37dd737308ce4dbba945ff6f20e3a85b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/37dd737308ce4dbba945ff6f20e3a85b 2023-12-03 10:55:27,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/31098948d1404099b0ab430d131828d5 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/31098948d1404099b0ab430d131828d5 2023-12-03 10:55:27,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/293d3e22d1c8490084ff38b9a3e5c788 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/293d3e22d1c8490084ff38b9a3e5c788 2023-12-03 10:55:27,606 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231203618c4734dae1442a93f6f710e196ef9a_del 2023-12-03 10:55:27,607 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203618c4734dae1442a93f6f710e196ef9a_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231203618c4734dae1442a93f6f710e196ef9a_del 2023-12-03 10:55:28,419 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cc06f9b1d4c4276bf3664f0dd63d4c3 2023-12-03 10:55:28,420 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/.tmp/family2/2cc06f9b1d4c4276bf3664f0dd63d4c3 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/2cc06f9b1d4c4276bf3664f0dd63d4c3 2023-12-03 10:55:28,424 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cc06f9b1d4c4276bf3664f0dd63d4c3 2023-12-03 10:55:28,425 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8289e8e52c6c796e8f6a76e95ee71cf9/family2 of 8289e8e52c6c796e8f6a76e95ee71cf9 into 2cc06f9b1d4c4276bf3664f0dd63d4c3(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:28,425 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:28,426 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:28,426 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 6a2227d5c782c10299a2b96f43c845b4/family1 is initiating major compaction (all files) 2023-12-03 10:55:28,426 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:28,426 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:28,426 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 6a2227d5c782c10299a2b96f43c845b4/family1 in ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:28,426 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/0f24fc7bdef94017956482e8ef5920c8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5e8c7b2d3191469485f6a83afbaf10f8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/85769646227e4bbb9dab49c33bf1762c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5494f9f22d254c63bb6d984e3e81fe61, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/2817bf7d1b0c437fa8d9d998eaeb231f] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp, totalSize=26.6 K 2023-12-03 10:55:28,426 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 0f24fc7bdef94017956482e8ef5920c8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600916365 2023-12-03 10:55:28,427 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 5e8c7b2d3191469485f6a83afbaf10f8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600917789 2023-12-03 10:55:28,427 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 85769646227e4bbb9dab49c33bf1762c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600919249 2023-12-03 10:55:28,427 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 5494f9f22d254c63bb6d984e3e81fe61, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600921060 2023-12-03 10:55:28,427 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 2817bf7d1b0c437fa8d9d998eaeb231f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:28,438 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 6a2227d5c782c10299a2b96f43c845b4#family1#compaction#154 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:28,446 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231203207baf9d2bdf460caa0d5d46e7acb747_del 2023-12-03 10:55:28,446 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203207baf9d2bdf460caa0d5d46e7acb747_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231203207baf9d2bdf460caa0d5d46e7acb747_del 2023-12-03 10:55:28,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/cfc115b49de14895a96e432b681557da, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/ccafe906267b469da3dac52782013394, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/7fce0ae5a5e44df5a2d4594a655ec763, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/4608ed7a77fd4b74b22a8a68c8e2092e, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/1179120cae014b1bb894a8920b8aacbc] to archive 2023-12-03 10:55:28,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:28,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/cfc115b49de14895a96e432b681557da to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/cfc115b49de14895a96e432b681557da 2023-12-03 10:55:28,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/ccafe906267b469da3dac52782013394 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/ccafe906267b469da3dac52782013394 2023-12-03 10:55:28,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/7fce0ae5a5e44df5a2d4594a655ec763 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/7fce0ae5a5e44df5a2d4594a655ec763 2023-12-03 10:55:28,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/4608ed7a77fd4b74b22a8a68c8e2092e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/4608ed7a77fd4b74b22a8a68c8e2092e 2023-12-03 10:55:28,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/1179120cae014b1bb894a8920b8aacbc to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family2/1179120cae014b1bb894a8920b8aacbc 2023-12-03 10:55:28,460 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93ef570cd86e4ccf98b2b777ade58f1e 2023-12-03 10:55:28,461 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family1/93ef570cd86e4ccf98b2b777ade58f1e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/93ef570cd86e4ccf98b2b777ade58f1e 2023-12-03 10:55:28,464 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93ef570cd86e4ccf98b2b777ade58f1e 2023-12-03 10:55:28,465 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6a2227d5c782c10299a2b96f43c845b4/family1 of 6a2227d5c782c10299a2b96f43c845b4 into 93ef570cd86e4ccf98b2b777ade58f1e(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:28,465 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:28,465 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:28,466 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 6a2227d5c782c10299a2b96f43c845b4/family2 is initiating major compaction (all files) 2023-12-03 10:55:28,466 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:28,466 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:28,466 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 6a2227d5c782c10299a2b96f43c845b4/family2 in ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:28,466 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/5f2c24200d01402080bd263260f9abb7, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/54bd4f252faf4f619c15ad21ec9e56da, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/beba55617d194c7eba75590bd0211810, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/f853b8683b284db1970255ec40d7646c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/1f71f1cf09f74160a59056ab53871c8e] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp, totalSize=25.3 K 2023-12-03 10:55:28,466 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 5f2c24200d01402080bd263260f9abb7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600916365 2023-12-03 10:55:28,467 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 54bd4f252faf4f619c15ad21ec9e56da, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600917789 2023-12-03 10:55:28,467 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting beba55617d194c7eba75590bd0211810, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600919249 2023-12-03 10:55:28,467 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting f853b8683b284db1970255ec40d7646c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600921060 2023-12-03 10:55:28,468 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 1f71f1cf09f74160a59056ab53871c8e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:28,475 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 6a2227d5c782c10299a2b96f43c845b4#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:28,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/0f24fc7bdef94017956482e8ef5920c8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5e8c7b2d3191469485f6a83afbaf10f8, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/85769646227e4bbb9dab49c33bf1762c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5494f9f22d254c63bb6d984e3e81fe61, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/2817bf7d1b0c437fa8d9d998eaeb231f] to archive 2023-12-03 10:55:28,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:28,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/0f24fc7bdef94017956482e8ef5920c8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/0f24fc7bdef94017956482e8ef5920c8 2023-12-03 10:55:28,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5e8c7b2d3191469485f6a83afbaf10f8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5e8c7b2d3191469485f6a83afbaf10f8 2023-12-03 10:55:28,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/85769646227e4bbb9dab49c33bf1762c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/85769646227e4bbb9dab49c33bf1762c 2023-12-03 10:55:28,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5494f9f22d254c63bb6d984e3e81fe61 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/5494f9f22d254c63bb6d984e3e81fe61 2023-12-03 10:55:28,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/2817bf7d1b0c437fa8d9d998eaeb231f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/2817bf7d1b0c437fa8d9d998eaeb231f 2023-12-03 10:55:28,882 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202312038998471d3def49cfa07179750dc9dd84_del 2023-12-03 10:55:28,882 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312038998471d3def49cfa07179750dc9dd84_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202312038998471d3def49cfa07179750dc9dd84_del 2023-12-03 10:55:29,695 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a80d3ec0e19f47a5aaf8ae54e61db6d0 2023-12-03 10:55:29,696 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/.tmp/family2/a80d3ec0e19f47a5aaf8ae54e61db6d0 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/a80d3ec0e19f47a5aaf8ae54e61db6d0 2023-12-03 10:55:29,699 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a80d3ec0e19f47a5aaf8ae54e61db6d0 2023-12-03 10:55:29,700 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6a2227d5c782c10299a2b96f43c845b4/family2 of 6a2227d5c782c10299a2b96f43c845b4 into a80d3ec0e19f47a5aaf8ae54e61db6d0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:29,700 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:29,703 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:29,706 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:29,709 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:29,709 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:29,714 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-12-03 10:55:29,725 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-12-03 10:55:29,728 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231203cec856858a564de5a94b9d1a78af5b3c_del 2023-12-03 10:55:29,731 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023120363abea350c39423b9da39454b1dcf076_del 2023-12-03 10:55:29,734 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231203207baf9d2bdf460caa0d5d46e7acb747_del 2023-12-03 10:55:29,734 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-12-03 10:55:29,735 DEBUG [Listener at localhost/33475] zookeeper.ReadOnlyZKClient(139): Connect 0x20748126 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:55:29,739 DEBUG [Listener at localhost/33475] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e31d9d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:55:29,740 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231203 for table='ns:testMinorCompaction' and column='family1' 2023-12-03 10:55:29,740 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231203 for table='ns:testMinorCompaction' and column='family1' 2023-12-03 10:55:29,740 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231203 for table='ns:testMinorCompaction' and column='family1' 2023-12-03 10:55:29,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/5f2c24200d01402080bd263260f9abb7, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/54bd4f252faf4f619c15ad21ec9e56da, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/beba55617d194c7eba75590bd0211810, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/f853b8683b284db1970255ec40d7646c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/1f71f1cf09f74160a59056ab53871c8e] to archive 2023-12-03 10:55:29,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:29,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/5f2c24200d01402080bd263260f9abb7 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/5f2c24200d01402080bd263260f9abb7 2023-12-03 10:55:29,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/54bd4f252faf4f619c15ad21ec9e56da to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/54bd4f252faf4f619c15ad21ec9e56da 2023-12-03 10:55:29,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/beba55617d194c7eba75590bd0211810 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/beba55617d194c7eba75590bd0211810 2023-12-03 10:55:29,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/f853b8683b284db1970255ec40d7646c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/f853b8683b284db1970255ec40d7646c 2023-12-03 10:55:29,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/1f71f1cf09f74160a59056ab53871c8e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family2/1f71f1cf09f74160a59056ab53871c8e 2023-12-03 10:55:29,763 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203b03f6ce8d9be423c9214c17c5495a424 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231203b03f6ce8d9be423c9214c17c5495a424 2023-12-03 10:55:29,764 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231203 table='ns:testMinorCompaction' column='family1' 2023-12-03 10:55:29,776 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:55:29,778 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:55:29,784 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:55:29,786 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:55:29,798 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231203/family1/fd4df1df2b474acab4378175b2cf5d38 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-12-03 10:55:29,798 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231203/family1/fd4df1df2b474acab4378175b2cf5d38}] 2023-12-03 10:55:29,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231203/family1/fd4df1df2b474acab4378175b2cf5d38 for inclusion in 6a2227d5c782c10299a2b96f43c845b4/family1 2023-12-03 10:55:29,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-12-03 10:55:29,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first=2 last= 2023-12-03 10:55:29,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:29,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231203/family1/fd4df1df2b474acab4378175b2cf5d38 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__6sdodqg8jm17grfoc726uar2bfp94i3me3j8bnhhke2eomp3067ntmtqmqd1118t/family1/fd4df1df2b474acab4378175b2cf5d38 2023-12-03 10:55:29,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__6sdodqg8jm17grfoc726uar2bfp94i3me3j8bnhhke2eomp3067ntmtqmqd1118t/family1/fd4df1df2b474acab4378175b2cf5d38 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/4ba738a436614f63a9a2c5ab6991b47c_SeqId_28_ 2023-12-03 10:55:29,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__6sdodqg8jm17grfoc726uar2bfp94i3me3j8bnhhke2eomp3067ntmtqmqd1118t/family1/fd4df1df2b474acab4378175b2cf5d38 into 6a2227d5c782c10299a2b96f43c845b4/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/4ba738a436614f63a9a2c5ab6991b47c_SeqId_28_ - updating store file list. 2023-12-03 10:55:29,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/4ba738a436614f63a9a2c5ab6991b47c_SeqId_28_ into 6a2227d5c782c10299a2b96f43c845b4/family1 2023-12-03 10:55:29,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__6sdodqg8jm17grfoc726uar2bfp94i3me3j8bnhhke2eomp3067ntmtqmqd1118t/family1/fd4df1df2b474acab4378175b2cf5d38 into 6a2227d5c782c10299a2b96f43c845b4/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/family1/4ba738a436614f63a9a2c5ab6991b47c_SeqId_28_) 2023-12-03 10:55:29,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__6sdodqg8jm17grfoc726uar2bfp94i3me3j8bnhhke2eomp3067ntmtqmqd1118t/family1/fd4df1df2b474acab4378175b2cf5d38 2023-12-03 10:55:29,815 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231203 table='ns:testMinorCompaction' column='family1' 2023-12-03 10:55:29,815 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:29,817 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231203be3c0e6c06bc4a719e9e482c58ce95d4 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231203be3c0e6c06bc4a719e9e482c58ce95d4 2023-12-03 10:55:29,817 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-12-03 10:55:29,817 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231203' 2023-12-03 10:55:29,817 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231203 for table='ns:testMinorCompaction' and column='family1' 2023-12-03 10:55:30,164 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023120319c8c0364932488ea79d2edd481da482 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023120319c8c0364932488ea79d2edd481da482 2023-12-03 10:55:30,165 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231203 table='ns:testMinorCompaction' column='family1' 2023-12-03 10:55:30,173 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203b6a14432243f44b5aca2af50b38613e6 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231203b6a14432243f44b5aca2af50b38613e6 2023-12-03 10:55:30,173 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231203 table='ns:testMinorCompaction' column='family1' 2023-12-03 10:55:30,189 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231203/family1/10524c9432144b18bf0e00952c6b0197 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-12-03 10:55:30,189 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231203/family1/10524c9432144b18bf0e00952c6b0197}] 2023-12-03 10:55:30,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231203/family1/10524c9432144b18bf0e00952c6b0197 for inclusion in 8289e8e52c6c796e8f6a76e95ee71cf9/family1 2023-12-03 10:55:30,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-12-03 10:55:30,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(777): Region bounds: first=1 last=2 2023-12-03 10:55:30,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:30,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231203/family1/10524c9432144b18bf0e00952c6b0197 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__23gg8hlis31jojbcv5ss9mgdsjdo02e1pdcfoao9akpc303v9361ndq33aq9rep4/family1/10524c9432144b18bf0e00952c6b0197 2023-12-03 10:55:30,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__23gg8hlis31jojbcv5ss9mgdsjdo02e1pdcfoao9akpc303v9361ndq33aq9rep4/family1/10524c9432144b18bf0e00952c6b0197 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/5d97673d27b642bd91569c72c48375c3_SeqId_28_ 2023-12-03 10:55:30,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__23gg8hlis31jojbcv5ss9mgdsjdo02e1pdcfoao9akpc303v9361ndq33aq9rep4/family1/10524c9432144b18bf0e00952c6b0197 into 8289e8e52c6c796e8f6a76e95ee71cf9/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/5d97673d27b642bd91569c72c48375c3_SeqId_28_ - updating store file list. 2023-12-03 10:55:30,202 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231203/family1/6d184639545842df8324b3c1507bbc4a first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-12-03 10:55:30,203 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231203/family1/6d184639545842df8324b3c1507bbc4a}] 2023-12-03 10:55:30,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/5d97673d27b642bd91569c72c48375c3_SeqId_28_ into 8289e8e52c6c796e8f6a76e95ee71cf9/family1 2023-12-03 10:55:30,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__23gg8hlis31jojbcv5ss9mgdsjdo02e1pdcfoao9akpc303v9361ndq33aq9rep4/family1/10524c9432144b18bf0e00952c6b0197 into 8289e8e52c6c796e8f6a76e95ee71cf9/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/family1/5d97673d27b642bd91569c72c48375c3_SeqId_28_) 2023-12-03 10:55:30,205 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231203/family1/6d184639545842df8324b3c1507bbc4a for inclusion in 236c5a2347aa1bfce918e0fb3cc51579/family1 2023-12-03 10:55:30,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__23gg8hlis31jojbcv5ss9mgdsjdo02e1pdcfoao9akpc303v9361ndq33aq9rep4/family1/10524c9432144b18bf0e00952c6b0197 2023-12-03 10:55:30,207 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231203 table='ns:testMinorCompaction' column='family1' 2023-12-03 10:55:30,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-12-03 10:55:30,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last=1 2023-12-03 10:55:30,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:30,207 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:30,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231203/family1/6d184639545842df8324b3c1507bbc4a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__pavepnv9t1t592ooneuchdu458o7klupthijskbr3ncu60ju120pq40vrk52ie5c/family1/6d184639545842df8324b3c1507bbc4a 2023-12-03 10:55:30,208 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231203c2987bf3aa4843a6b3a578d2e4960ab8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231203c2987bf3aa4843a6b3a578d2e4960ab8 2023-12-03 10:55:30,208 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-12-03 10:55:30,208 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231203' 2023-12-03 10:55:30,209 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231203 for table='ns:testMinorCompaction' and column='family1' 2023-12-03 10:55:30,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__pavepnv9t1t592ooneuchdu458o7klupthijskbr3ncu60ju120pq40vrk52ie5c/family1/6d184639545842df8324b3c1507bbc4a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/feef4189b87c48caac84666e7e06c5b1_SeqId_28_ 2023-12-03 10:55:30,210 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__pavepnv9t1t592ooneuchdu458o7klupthijskbr3ncu60ju120pq40vrk52ie5c/family1/6d184639545842df8324b3c1507bbc4a into 236c5a2347aa1bfce918e0fb3cc51579/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/feef4189b87c48caac84666e7e06c5b1_SeqId_28_ - updating store file list. 2023-12-03 10:55:30,213 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/feef4189b87c48caac84666e7e06c5b1_SeqId_28_ into 236c5a2347aa1bfce918e0fb3cc51579/family1 2023-12-03 10:55:30,213 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__pavepnv9t1t592ooneuchdu458o7klupthijskbr3ncu60ju120pq40vrk52ie5c/family1/6d184639545842df8324b3c1507bbc4a into 236c5a2347aa1bfce918e0fb3cc51579/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/family1/feef4189b87c48caac84666e7e06c5b1_SeqId_28_) 2023-12-03 10:55:30,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__ns_testMinorCompaction__pavepnv9t1t592ooneuchdu458o7klupthijskbr3ncu60ju120pq40vrk52ie5c/family1/6d184639545842df8324b3c1507bbc4a 2023-12-03 10:55:30,215 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231203 table='ns:testMinorCompaction' column='family1' 2023-12-03 10:55:30,216 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:30,217 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023120349f99a507f814b4ead5a219714fa1388 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023120349f99a507f814b4ead5a219714fa1388 2023-12-03 10:55:30,217 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-12-03 10:55:30,217 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231203' 2023-12-03 10:55:30,217 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231203 for table='ns:testMinorCompaction' and column='family1' 2023-12-03 10:55:30,217 INFO [Listener at localhost/33475] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-12-03 10:55:30,220 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:30,221 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:30,224 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:30,224 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:30,240 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=254 (was 297), OpenFileDescriptor=654 (was 806), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=166 (was 167), ProcessCount=171 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=3067 (was 3118) 2023-12-03 10:55:30,251 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=254, OpenFileDescriptor=654, MaxFileDescriptor=60000, SystemLoadAverage=166, ProcessCount=171, AvailableMemoryMB=3066 2023-12-03 10:55:30,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-12-03 10:55:30,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:30,254 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:55:30,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-12-03 10:55:30,255 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:55:30,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-12-03 10:55:30,256 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce 2023-12-03 10:55:30,256 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce empty. 2023-12-03 10:55:30,256 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce 2023-12-03 10:55:30,256 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-12-03 10:55:30,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-12-03 10:55:30,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-12-03 10:55:30,662 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-12-03 10:55:30,663 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => c385de4f6e36b035b666ba4cdfb178ce, NAME => 'testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:55:30,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-12-03 10:55:31,070 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:31,070 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing c385de4f6e36b035b666ba4cdfb178ce, disabling compactions & flushes 2023-12-03 10:55:31,070 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:31,070 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:31,070 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. after waiting 0 ms 2023-12-03 10:55:31,070 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:31,070 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:31,070 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:31,072 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:55:31,073 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701600931073"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600931073"}]},"ts":"1701600931073"} 2023-12-03 10:55:31,074 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-03 10:55:31,075 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:55:31,075 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600931075"}]},"ts":"1701600931075"} 2023-12-03 10:55:31,076 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-12-03 10:55:31,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c385de4f6e36b035b666ba4cdfb178ce, ASSIGN}] 2023-12-03 10:55:31,080 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c385de4f6e36b035b666ba4cdfb178ce, ASSIGN 2023-12-03 10:55:31,080 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c385de4f6e36b035b666ba4cdfb178ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:55:31,231 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=c385de4f6e36b035b666ba4cdfb178ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:31,231 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701600931231"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600931231"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600931231"}]},"ts":"1701600931231"} 2023-12-03 10:55:31,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure c385de4f6e36b035b666ba4cdfb178ce, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:31,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-12-03 10:55:31,383 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:31,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:31,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c385de4f6e36b035b666ba4cdfb178ce, NAME => 'testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce.', STARTKEY => '', ENDKEY => ''} 2023-12-03 10:55:31,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy c385de4f6e36b035b666ba4cdfb178ce 2023-12-03 10:55:31,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:31,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c385de4f6e36b035b666ba4cdfb178ce 2023-12-03 10:55:31,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c385de4f6e36b035b666ba4cdfb178ce 2023-12-03 10:55:31,386 INFO [StoreOpener-c385de4f6e36b035b666ba4cdfb178ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c385de4f6e36b035b666ba4cdfb178ce 2023-12-03 10:55:31,388 DEBUG [StoreOpener-c385de4f6e36b035b666ba4cdfb178ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1 2023-12-03 10:55:31,388 DEBUG [StoreOpener-c385de4f6e36b035b666ba4cdfb178ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1 2023-12-03 10:55:31,388 INFO [StoreOpener-c385de4f6e36b035b666ba4cdfb178ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c385de4f6e36b035b666ba4cdfb178ce columnFamilyName family1 2023-12-03 10:55:31,389 INFO [StoreOpener-c385de4f6e36b035b666ba4cdfb178ce-1] regionserver.HStore(310): Store=c385de4f6e36b035b666ba4cdfb178ce/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:31,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce 2023-12-03 10:55:31,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce 2023-12-03 10:55:31,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c385de4f6e36b035b666ba4cdfb178ce 2023-12-03 10:55:31,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:55:31,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c385de4f6e36b035b666ba4cdfb178ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66631746, jitterRate=-0.007109612226486206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-03 10:55:31,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:31,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce., pid=114, masterSystemTime=1701600931383 2023-12-03 10:55:31,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:31,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:31,396 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=c385de4f6e36b035b666ba4cdfb178ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:31,396 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701600931396"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600931396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600931396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600931396"}]},"ts":"1701600931396"} 2023-12-03 10:55:31,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=114, resume processing ppid=113 2023-12-03 10:55:31,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure c385de4f6e36b035b666ba4cdfb178ce, server=jenkins-hbase4.apache.org,44259,1701600798821 in 165 msec 2023-12-03 10:55:31,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=113, resume processing ppid=112 2023-12-03 10:55:31,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c385de4f6e36b035b666ba4cdfb178ce, ASSIGN in 319 msec 2023-12-03 10:55:31,399 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:55:31,400 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600931399"}]},"ts":"1701600931399"} 2023-12-03 10:55:31,400 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-12-03 10:55:31,402 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:55:31,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1510 sec 2023-12-03 10:55:32,226 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:32,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-12-03 10:55:32,359 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-12-03 10:55:32,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:32,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:32,382 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:32,382 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:32,382 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:55:32,382 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:55:32,382 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:32,382 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:32,385 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:32,385 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:32,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:32,385 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:32,385 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:32,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:32,386 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:32,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:32,386 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:55:32,386 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:32,386 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:55:32,388 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:55:32,388 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:32,388 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:32,388 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. started... 2023-12-03 10:55:32,389 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c385de4f6e36b035b666ba4cdfb178ce 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-12-03 10:55:32,810 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113032f53e40af404117a313f628acd8038d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113032f53e40af404117a313f628acd8038d 2023-12-03 10:55:33,213 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/5f83dd73746140f4847e71685ff60b9b 2023-12-03 10:55:33,217 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/5f83dd73746140f4847e71685ff60b9b as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5f83dd73746140f4847e71685ff60b9b 2023-12-03 10:55:33,220 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5f83dd73746140f4847e71685ff60b9b, entries=1000, sequenceid=5, filesize=166.0 K 2023-12-03 10:55:33,221 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c385de4f6e36b035b666ba4cdfb178ce in 832ms, sequenceid=5, compaction requested=false 2023-12-03 10:55:33,221 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:33,222 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:33,222 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:55:33,222 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:55:33,222 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,222 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:55:33,222 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:55:33,226 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,226 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:33,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:33,227 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,227 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:33,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:55:33,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64607cf8[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:33,228 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:55:33,228 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,229 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,229 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:55:33,229 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:55:33,229 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:33,229 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,229 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:33,230 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:55:33,230 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,230 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:33,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:33,230 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:55:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:33,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:55:33,233 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:55:33,233 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:33,233 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:33,233 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,233 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:33,235 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,235 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:33,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:33,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,235 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:33,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:33,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:33,236 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:33,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:33,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,237 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:33,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,239 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,239 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:33,239 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:33,239 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:33,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:33,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:33,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:33,239 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:33,239 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,239 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,239 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,239 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,239 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:33,239 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:33,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:33,240 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:33,340 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:33,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:33,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:33,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:33,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,345 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:33,345 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:33,345 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:55:33,345 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:55:33,346 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,346 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,347 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,347 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:33,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:33,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:33,347 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:33,347 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:33,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,348 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,348 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:33,348 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:55:33,348 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:33,348 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:55:33,348 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:55:33,348 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:33,348 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:33,349 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. started... 2023-12-03 10:55:33,349 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c385de4f6e36b035b666ba4cdfb178ce 1/1 column families, dataSize=74 B heapSize=408 B 2023-12-03 10:55:33,759 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289ca46d756dcc4631bd8c84ff43a487a8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511289ca46d756dcc4631bd8c84ff43a487a8 2023-12-03 10:55:34,163 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/63453144b566401280e4a08ced63da6c 2023-12-03 10:55:34,167 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/63453144b566401280e4a08ced63da6c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/63453144b566401280e4a08ced63da6c 2023-12-03 10:55:34,170 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/63453144b566401280e4a08ced63da6c, entries=1, sequenceid=9, filesize=5.0 K 2023-12-03 10:55:34,171 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c385de4f6e36b035b666ba4cdfb178ce in 822ms, sequenceid=9, compaction requested=false 2023-12-03 10:55:34,171 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:34,171 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:34,171 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:55:34,171 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:55:34,171 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,171 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:55:34,171 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:55:34,173 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,173 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:34,173 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,173 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:34,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:34,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:34,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:55:34,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7db0662[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:34,174 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:55:34,175 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,176 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,176 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:55:34,176 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:55:34,176 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:34,176 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,176 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:34,177 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:55:34,177 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:34,177 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,177 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:55:34,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:34,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:34,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:34,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:34,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:34,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:34,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:55:34,179 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:55:34,179 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:34,179 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:34,179 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,179 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:34,181 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,181 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:34,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:34,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,182 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:34,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:34,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:34,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:34,182 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:34,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,183 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:34,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,185 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,185 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,185 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:34,185 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,185 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:34,185 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:34,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:34,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:34,185 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:34,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:34,186 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,186 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,186 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,186 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:34,186 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:34,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:34,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:34,286 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:34,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:34,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:34,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:34,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,291 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:34,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:34,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:55:34,291 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:55:34,292 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,292 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,293 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:34,293 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:34,293 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,293 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,294 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,294 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:55:34,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,294 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:55:34,294 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:34,294 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:55:34,294 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:55:34,294 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:34,294 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:34,295 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. started... 2023-12-03 10:55:34,295 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c385de4f6e36b035b666ba4cdfb178ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:55:34,708 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bf5dba2f10534d28b2383d5e9ee07f25 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201bf5dba2f10534d28b2383d5e9ee07f25 2023-12-03 10:55:34,712 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/5d8d85799d3c43409b5af41786ea5cd9 2023-12-03 10:55:34,715 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/5d8d85799d3c43409b5af41786ea5cd9 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5d8d85799d3c43409b5af41786ea5cd9 2023-12-03 10:55:34,718 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5d8d85799d3c43409b5af41786ea5cd9, entries=1, sequenceid=13, filesize=4.9 K 2023-12-03 10:55:34,719 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c385de4f6e36b035b666ba4cdfb178ce in 424ms, sequenceid=13, compaction requested=true 2023-12-03 10:55:34,719 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:34,719 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:34,719 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:55:34,719 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:55:34,719 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,719 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:55:34,719 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:55:34,720 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,720 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:34,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:34,721 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,721 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:34,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:34,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:34,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:34,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:55:34,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8e8f675[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:34,722 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:55:34,722 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,724 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,724 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:55:34,725 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:55:34,725 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:34,725 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,725 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:34,726 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,726 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:55:34,726 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:34,726 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:55:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:34,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:55:34,728 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:55:34,728 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:34,728 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:34,728 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,728 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:34,729 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,729 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,730 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:34,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:34,730 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,731 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,737 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,737 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,737 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:34,737 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,737 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:34,737 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:34,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:34,737 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:34,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:34,737 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,738 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,738 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:34,738 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:34,738 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:34,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:34,838 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:34,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:34,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:34,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:34,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,843 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:34,843 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:34,843 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:55:34,843 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:55:34,843 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,843 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,845 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:34,845 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:34,845 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:34,845 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,846 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,846 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:55:34,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:34,846 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:55:34,846 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:34,846 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:55:34,846 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:55:34,846 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:34,846 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:34,846 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. started... 2023-12-03 10:55:34,846 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c385de4f6e36b035b666ba4cdfb178ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:55:35,256 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205097b46c4430044e3a530d2de05c41ca0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205097b46c4430044e3a530d2de05c41ca0 2023-12-03 10:55:35,660 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/9c1b372ff3d24b8e8474bc507ef647aa 2023-12-03 10:55:35,665 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/9c1b372ff3d24b8e8474bc507ef647aa as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9c1b372ff3d24b8e8474bc507ef647aa 2023-12-03 10:55:35,669 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9c1b372ff3d24b8e8474bc507ef647aa, entries=1, sequenceid=17, filesize=4.9 K 2023-12-03 10:55:35,670 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c385de4f6e36b035b666ba4cdfb178ce in 823ms, sequenceid=17, compaction requested=true 2023-12-03 10:55:35,670 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:35,670 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:35,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:55:35,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:55:35,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:55:35,670 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:55:35,672 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:35,673 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,673 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:35,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:55:35,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e07d73[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:35,674 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:55:35,674 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,675 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,675 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:55:35,675 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:55:35,675 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:35,675 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,676 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:35,677 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,677 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:55:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:35,677 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:35,677 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:55:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:35,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:55:35,679 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:55:35,679 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:35,679 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:35,679 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,679 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:35,681 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,681 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:35,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,681 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:35,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:35,682 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:35,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,683 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:35,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:35,686 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:35,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:35,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:35,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-12-03 10:55:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:35,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:35,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,686 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,686 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:35,687 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:35,687 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:35,687 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:35,787 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:35,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:35,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:35,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:35,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,792 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:35,793 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:35,793 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:55:35,793 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:55:35,793 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,793 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,794 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,794 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:35,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:35,794 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:35,794 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,795 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,795 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:55:35,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:55:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:55:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:55:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:35,796 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:35,796 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. started... 2023-12-03 10:55:35,796 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c385de4f6e36b035b666ba4cdfb178ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:55:36,206 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228fad1370cf56e4a28872dd14664a7a918 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228fad1370cf56e4a28872dd14664a7a918 2023-12-03 10:55:36,610 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/27a27d6b14344544a7fdfeb53f075c08 2023-12-03 10:55:36,615 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/27a27d6b14344544a7fdfeb53f075c08 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/27a27d6b14344544a7fdfeb53f075c08 2023-12-03 10:55:36,618 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/27a27d6b14344544a7fdfeb53f075c08, entries=1, sequenceid=21, filesize=4.9 K 2023-12-03 10:55:36,618 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c385de4f6e36b035b666ba4cdfb178ce in 822ms, sequenceid=21, compaction requested=true 2023-12-03 10:55:36,619 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:36,619 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:36,619 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:55:36,619 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:55:36,619 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,619 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:55:36,619 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:55:36,620 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,620 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:36,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:36,621 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,621 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:36,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:36,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:36,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:36,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:55:36,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31805ceb[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:36,622 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:55:36,622 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,624 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,625 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:55:36,625 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:55:36,625 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:36,625 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,625 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:36,626 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:55:36,626 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:36,626 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,626 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:55:36,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:36,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:36,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:36,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:36,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:36,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:36,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:55:36,628 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:55:36,628 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:36,628 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:36,628 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,628 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:36,630 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,630 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,630 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:36,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:36,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:36,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:36,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:36,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:36,630 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:36,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,632 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:36,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:36,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,635 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:36,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:36,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:36,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:36,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-12-03 10:55:36,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,635 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:36,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:36,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:36,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:36,636 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:36,636 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:36,736 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:36,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:36,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:36,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:36,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,742 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:36,742 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:36,742 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:55:36,742 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:55:36,742 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,742 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,745 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,745 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:36,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:36,745 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:36,745 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,746 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,746 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:55:36,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:55:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:36,747 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:55:36,748 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:55:36,748 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:36,748 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. started... 2023-12-03 10:55:36,748 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:36,748 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c385de4f6e36b035b666ba4cdfb178ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:55:36,938 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:55:37,159 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123127799b2cb63e4e71812a358645b59588 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123127799b2cb63e4e71812a358645b59588 2023-12-03 10:55:37,564 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/1aea0d2a6c5544aea7b5815b2ad14423 2023-12-03 10:55:37,568 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/1aea0d2a6c5544aea7b5815b2ad14423 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/1aea0d2a6c5544aea7b5815b2ad14423 2023-12-03 10:55:37,571 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/1aea0d2a6c5544aea7b5815b2ad14423, entries=1, sequenceid=25, filesize=4.9 K 2023-12-03 10:55:37,571 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c385de4f6e36b035b666ba4cdfb178ce in 823ms, sequenceid=25, compaction requested=true 2023-12-03 10:55:37,572 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:37,572 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:37,572 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:55:37,572 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:55:37,572 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,572 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:55:37,572 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:55:37,573 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,573 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:37,574 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,574 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:37,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:37,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:37,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:37,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:55:37,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6eb7a4af[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:37,575 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:55:37,575 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,576 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,576 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:55:37,576 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:55:37,576 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:37,577 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,577 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:37,581 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:55:37,581 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:37,581 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,581 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:55:37,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:37,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:37,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:37,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:37,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:37,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:37,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:55:37,584 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:55:37,584 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:37,584 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:37,584 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,584 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:37,585 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,585 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:37,585 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:37,586 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:37,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,587 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:37,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,590 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,590 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:37,590 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:37,590 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:37,590 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:37,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:37,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:37,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:37,590 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,590 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,590 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,590 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,590 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,590 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:37,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:37,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:37,591 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:37,691 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:37,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:37,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:37,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:37,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,696 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:37,697 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:37,697 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:55:37,697 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:55:37,697 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,697 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,698 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,698 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:37,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:37,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:37,698 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:37,699 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:37,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:37,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,699 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,699 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:55:37,700 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:55:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:55:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:55:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:37,700 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:37,700 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. started... 2023-12-03 10:55:37,700 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c385de4f6e36b035b666ba4cdfb178ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:55:38,110 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013dc8a6d7fd264341bc8ce405993fac2b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013dc8a6d7fd264341bc8ce405993fac2b 2023-12-03 10:55:38,515 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/ce70c8bea4b140038e22b5ed9e5997b7 2023-12-03 10:55:38,519 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/ce70c8bea4b140038e22b5ed9e5997b7 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ce70c8bea4b140038e22b5ed9e5997b7 2023-12-03 10:55:38,523 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ce70c8bea4b140038e22b5ed9e5997b7, entries=1, sequenceid=29, filesize=4.9 K 2023-12-03 10:55:38,524 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c385de4f6e36b035b666ba4cdfb178ce in 824ms, sequenceid=29, compaction requested=true 2023-12-03 10:55:38,524 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:38,524 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:38,524 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:55:38,524 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:55:38,524 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,524 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:55:38,524 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:55:38,526 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,526 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:38,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:55:38,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21a3bc52[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:38,529 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:55:38,529 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,530 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,530 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:55:38,530 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:55:38,530 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:38,530 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,530 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:38,533 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:55:38,533 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,533 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:38,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:38,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:38,533 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:55:38,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:38,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:38,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:55:38,535 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:55:38,535 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:38,535 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:38,535 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,535 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:38,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,536 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:38,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:38,537 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:38,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,538 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:38,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,540 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,540 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,540 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:38,540 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:38,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:38,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:38,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:38,540 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:38,540 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,540 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:38,541 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,541 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,541 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,541 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:38,541 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:38,641 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:38,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:38,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:38,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:38,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,647 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:38,647 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:38,647 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:55:38,647 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:55:38,647 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,647 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,648 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,648 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:38,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:38,648 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:38,648 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:38,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,649 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,649 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:55:38,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:38,649 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:55:38,649 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:38,649 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:55:38,649 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:55:38,649 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:38,650 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:38,650 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. started... 2023-12-03 10:55:38,650 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c385de4f6e36b035b666ba4cdfb178ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:55:39,060 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ba7cba45cd984e919a313bc4a5eca8d7 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ba7cba45cd984e919a313bc4a5eca8d7 2023-12-03 10:55:39,465 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/cca5e57de73e487eaa1d6a7bd0b77699 2023-12-03 10:55:39,468 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/cca5e57de73e487eaa1d6a7bd0b77699 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/cca5e57de73e487eaa1d6a7bd0b77699 2023-12-03 10:55:39,471 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/cca5e57de73e487eaa1d6a7bd0b77699, entries=1, sequenceid=33, filesize=4.9 K 2023-12-03 10:55:39,471 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c385de4f6e36b035b666ba4cdfb178ce in 821ms, sequenceid=33, compaction requested=true 2023-12-03 10:55:39,472 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:39,472 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:39,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:55:39,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:55:39,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:55:39,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:55:39,473 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,473 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:39,474 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,474 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@747d46f0[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:39,475 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:55:39,475 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,476 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,476 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:55:39,476 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:55:39,476 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:39,476 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,476 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:39,478 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:55:39,478 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:39,478 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,478 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:55:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:39,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:39,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:55:39,481 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:55:39,481 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:39,481 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:39,481 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,481 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:39,482 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,482 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,482 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:39,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:39,483 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:39,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,484 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:39,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,486 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,486 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,486 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:39,486 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:39,486 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:39,486 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:39,487 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,486 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:39,486 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:39,487 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:39,487 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:39,487 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:39,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:39,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:39,587 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:39,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:39,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:39,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:39,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,593 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:39,594 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:39,594 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:55:39,594 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:55:39,594 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,594 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,595 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:39,595 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:39,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:39,596 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,596 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:39,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,596 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,597 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:55:39,597 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:55:39,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:39,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:55:39,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:55:39,597 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:39,597 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:39,597 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. started... 2023-12-03 10:55:39,597 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c385de4f6e36b035b666ba4cdfb178ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:55:39,608 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f295843afbfb45b7b1b4dc3a27a93984 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907f295843afbfb45b7b1b4dc3a27a93984 2023-12-03 10:55:39,616 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/134af0b66cc6422a89c3be049ba3c65d 2023-12-03 10:55:39,621 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/134af0b66cc6422a89c3be049ba3c65d as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/134af0b66cc6422a89c3be049ba3c65d 2023-12-03 10:55:39,626 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/134af0b66cc6422a89c3be049ba3c65d, entries=1, sequenceid=37, filesize=4.9 K 2023-12-03 10:55:39,626 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c385de4f6e36b035b666ba4cdfb178ce in 29ms, sequenceid=37, compaction requested=true 2023-12-03 10:55:39,627 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:39,627 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:55:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:55:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:55:39,627 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:55:39,637 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,637 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:39,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:39,637 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,637 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:39,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:39,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:39,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:39,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:55:39,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47292b90[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:39,639 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:55:39,640 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,641 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,641 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:55:39,641 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:55:39,641 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:39,641 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,641 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:55:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:39,642 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,642 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:55:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:39,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:39,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:55:39,646 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:55:39,646 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:39,646 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:39,646 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,646 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:39,647 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:39,648 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,648 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:39,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:39,648 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:39,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,650 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,653 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,653 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:39,653 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:39,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:39,653 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:39,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:39,653 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:39,653 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,653 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,653 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,654 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,654 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:39,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-12-03 10:55:39,654 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:39,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:39,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:39,654 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:39,754 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:39,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:39,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:39,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:39,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,762 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:39,762 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:39,762 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-12-03 10:55:39,762 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-12-03 10:55:39,763 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,763 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,764 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:39,764 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:39,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:39,764 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,765 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,766 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-12-03 10:55:39,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,766 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-12-03 10:55:39,766 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:39,766 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-12-03 10:55:39,766 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-12-03 10:55:39,766 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:39,766 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:39,766 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. started... 2023-12-03 10:55:39,766 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c385de4f6e36b035b666ba4cdfb178ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-12-03 10:55:39,777 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205a77e1a40ca048c9b573b26340d15fd2 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511205a77e1a40ca048c9b573b26340d15fd2 2023-12-03 10:55:39,782 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/ed5bd8fd995146938177ded1c85f639f 2023-12-03 10:55:39,786 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/ed5bd8fd995146938177ded1c85f639f as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ed5bd8fd995146938177ded1c85f639f 2023-12-03 10:55:39,790 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ed5bd8fd995146938177ded1c85f639f, entries=1, sequenceid=41, filesize=4.9 K 2023-12-03 10:55:39,790 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c385de4f6e36b035b666ba4cdfb178ce in 24ms, sequenceid=41, compaction requested=true 2023-12-03 10:55:39,791 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:39,791 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-12-03 10:55:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-12-03 10:55:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-12-03 10:55:39,791 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-12-03 10:55:39,792 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,792 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:39,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:39,793 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,793 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:39,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:39,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:39,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:39,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-12-03 10:55:39,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14e86d06[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:39,794 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-12-03 10:55:39,794 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,795 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,795 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-12-03 10:55:39,795 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-12-03 10:55:39,795 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:39,795 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,795 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:39,798 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-12-03 10:55:39,798 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:39,798 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,798 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-12-03 10:55:39,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:39,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:39,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:39,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:39,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:39,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:39,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-12-03 10:55:39,801 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-12-03 10:55:39,801 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:39,801 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:39,801 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,801 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:39,802 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,802 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:39,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:39,802 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:39,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:39,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:39,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:39,803 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:39,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,804 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:39,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,806 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,806 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,806 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:39,806 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:39,806 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:39,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:39,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-12-03 10:55:39,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:39,806 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:39,806 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:39,806 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,807 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,807 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:39,807 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:39,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:39,807 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:39,907 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:39,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:39,909 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-12-03 10:55:39,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:55:39,912 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:55:39,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:55:39,913 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601539912 2023-12-03 10:55:39,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-12-03 10:55:39,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-12-03 10:55:39,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:55:39,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x5b900934 to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:55:39,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fccd676, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:55:39,924 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:55:40,767 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010343e54e49e9394d258ec680f79379283a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010343e54e49e9394d258ec680f79379283a 2023-12-03 10:55:40,768 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:55:40,781 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:55:40,782 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:55:40,788 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:55:40,789 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:55:40,796 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e7a86e29a2ca400e9eddde7fb6d435c0 first=Optional[r5] last=Optional[r6] 2023-12-03 10:55:40,796 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e7a86e29a2ca400e9eddde7fb6d435c0}] 2023-12-03 10:55:40,804 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e7a86e29a2ca400e9eddde7fb6d435c0 for inclusion in c385de4f6e36b035b666ba4cdfb178ce/family1 2023-12-03 10:55:40,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-12-03 10:55:40,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:55:40,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:40,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e7a86e29a2ca400e9eddde7fb6d435c0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__it8pcm7hhkq67qvl888csj2j0p21q4l5dgbrnqaqfomvi95m9a347s5i5p8b2ur0/family1/e7a86e29a2ca400e9eddde7fb6d435c0 2023-12-03 10:55:40,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__it8pcm7hhkq67qvl888csj2j0p21q4l5dgbrnqaqfomvi95m9a347s5i5p8b2ur0/family1/e7a86e29a2ca400e9eddde7fb6d435c0 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9d5119a8dfea4cb2a7783435cfffcd1f_SeqId_44_ 2023-12-03 10:55:40,809 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__it8pcm7hhkq67qvl888csj2j0p21q4l5dgbrnqaqfomvi95m9a347s5i5p8b2ur0/family1/e7a86e29a2ca400e9eddde7fb6d435c0 into c385de4f6e36b035b666ba4cdfb178ce/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9d5119a8dfea4cb2a7783435cfffcd1f_SeqId_44_ - updating store file list. 2023-12-03 10:55:40,813 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9d5119a8dfea4cb2a7783435cfffcd1f_SeqId_44_ into c385de4f6e36b035b666ba4cdfb178ce/family1 2023-12-03 10:55:40,813 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__it8pcm7hhkq67qvl888csj2j0p21q4l5dgbrnqaqfomvi95m9a347s5i5p8b2ur0/family1/e7a86e29a2ca400e9eddde7fb6d435c0 into c385de4f6e36b035b666ba4cdfb178ce/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9d5119a8dfea4cb2a7783435cfffcd1f_SeqId_44_) 2023-12-03 10:55:40,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__it8pcm7hhkq67qvl888csj2j0p21q4l5dgbrnqaqfomvi95m9a347s5i5p8b2ur0/family1/e7a86e29a2ca400e9eddde7fb6d435c0 2023-12-03 10:55:40,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-12-03 10:55:40,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-12-03 10:55:40,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(1912): c385de4f6e36b035b666ba4cdfb178ce/family1 is initiating minor compaction 2023-12-03 10:55:40,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@441f9e8a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:55:40,816 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c385de4f6e36b035b666ba4cdfb178ce/family1 in testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:40,816 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/63453144b566401280e4a08ced63da6c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5d8d85799d3c43409b5af41786ea5cd9, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9c1b372ff3d24b8e8474bc507ef647aa, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/27a27d6b14344544a7fdfeb53f075c08, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/1aea0d2a6c5544aea7b5815b2ad14423, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ce70c8bea4b140038e22b5ed9e5997b7, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/cca5e57de73e487eaa1d6a7bd0b77699, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/134af0b66cc6422a89c3be049ba3c65d, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ed5bd8fd995146938177ded1c85f639f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9d5119a8dfea4cb2a7783435cfffcd1f_SeqId_44_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp, totalSize=49.7 K 2023-12-03 10:55:40,816 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 63453144b566401280e4a08ced63da6c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-12-03 10:55:40,816 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 5d8d85799d3c43409b5af41786ea5cd9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-12-03 10:55:40,817 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 9c1b372ff3d24b8e8474bc507ef647aa, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-12-03 10:55:40,817 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 27a27d6b14344544a7fdfeb53f075c08, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-12-03 10:55:40,817 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 1aea0d2a6c5544aea7b5815b2ad14423, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-12-03 10:55:40,817 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting ce70c8bea4b140038e22b5ed9e5997b7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-12-03 10:55:40,817 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting cca5e57de73e487eaa1d6a7bd0b77699, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-12-03 10:55:40,817 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 134af0b66cc6422a89c3be049ba3c65d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-12-03 10:55:40,817 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting ed5bd8fd995146938177ded1c85f639f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-12-03 10:55:40,817 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] compactions.Compactor(207): Compacting 9d5119a8dfea4cb2a7783435cfffcd1f_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-12-03 10:55:40,819 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:55:40,820 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:40,821 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013dc8a6d7fd264341bc8ce405993fac2b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013dc8a6d7fd264341bc8ce405993fac2b 2023-12-03 10:55:40,824 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ba7cba45cd984e919a313bc4a5eca8d7 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ba7cba45cd984e919a313bc4a5eca8d7 2023-12-03 10:55:40,824 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-12-03 10:55:40,824 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-12-03 10:55:40,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:55:40,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:55:40,858 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] throttle.PressureAwareThroughputController(145): c385de4f6e36b035b666ba4cdfb178ce#family1#compaction#166 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:41,683 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/0d199ed057244dd19b7acf9c736f2d0a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/0d199ed057244dd19b7acf9c736f2d0a 2023-12-03 10:55:41,688 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c6c7eb3481de471fb5e1fd2d9553a1ef to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231c6c7eb3481de471fb5e1fd2d9553a1ef 2023-12-03 10:55:41,689 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c385de4f6e36b035b666ba4cdfb178ce/family1 of c385de4f6e36b035b666ba4cdfb178ce into 0d199ed057244dd19b7acf9c736f2d0a(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:41,689 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:41,689 INFO [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1701600940816; duration=0sec 2023-12-03 10:55:41,689 DEBUG [RS:0;jenkins-hbase4:44259-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:55:41,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:55:41,731 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ce59e371520043adb5516ba220b4bdd1 first=Optional[r1] last=Optional[r4] 2023-12-03 10:55:41,732 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ce59e371520043adb5516ba220b4bdd1}] 2023-12-03 10:55:41,736 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ce59e371520043adb5516ba220b4bdd1 for inclusion in c385de4f6e36b035b666ba4cdfb178ce/family1 2023-12-03 10:55:41,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-12-03 10:55:41,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:55:41,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:41,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ce59e371520043adb5516ba220b4bdd1 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dmjr0iugrslsnf5lk2t7del8te6r6io2dm2f65n7peik72nhuqb5b9sq2u2o14os/family1/ce59e371520043adb5516ba220b4bdd1 2023-12-03 10:55:41,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dmjr0iugrslsnf5lk2t7del8te6r6io2dm2f65n7peik72nhuqb5b9sq2u2o14os/family1/ce59e371520043adb5516ba220b4bdd1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/a3a3f54e4a834cd39f80366e3eee0c2f_SeqId_47_ 2023-12-03 10:55:41,747 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dmjr0iugrslsnf5lk2t7del8te6r6io2dm2f65n7peik72nhuqb5b9sq2u2o14os/family1/ce59e371520043adb5516ba220b4bdd1 into c385de4f6e36b035b666ba4cdfb178ce/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/a3a3f54e4a834cd39f80366e3eee0c2f_SeqId_47_ - updating store file list. 2023-12-03 10:55:41,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/63453144b566401280e4a08ced63da6c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5d8d85799d3c43409b5af41786ea5cd9, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9c1b372ff3d24b8e8474bc507ef647aa, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/27a27d6b14344544a7fdfeb53f075c08, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/1aea0d2a6c5544aea7b5815b2ad14423, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ce70c8bea4b140038e22b5ed9e5997b7, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/cca5e57de73e487eaa1d6a7bd0b77699, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/134af0b66cc6422a89c3be049ba3c65d, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ed5bd8fd995146938177ded1c85f639f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9d5119a8dfea4cb2a7783435cfffcd1f_SeqId_44_] to archive 2023-12-03 10:55:41,754 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/a3a3f54e4a834cd39f80366e3eee0c2f_SeqId_47_ into c385de4f6e36b035b666ba4cdfb178ce/family1 2023-12-03 10:55:41,754 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dmjr0iugrslsnf5lk2t7del8te6r6io2dm2f65n7peik72nhuqb5b9sq2u2o14os/family1/ce59e371520043adb5516ba220b4bdd1 into c385de4f6e36b035b666ba4cdfb178ce/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/a3a3f54e4a834cd39f80366e3eee0c2f_SeqId_47_) 2023-12-03 10:55:41,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:41,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dmjr0iugrslsnf5lk2t7del8te6r6io2dm2f65n7peik72nhuqb5b9sq2u2o14os/family1/ce59e371520043adb5516ba220b4bdd1 2023-12-03 10:55:41,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-12-03 10:55:41,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-12-03 10:55:41,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(1912): c385de4f6e36b035b666ba4cdfb178ce/family1 is initiating minor compaction (all files) 2023-12-03 10:55:41,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@60fed02f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-12-03 10:55:41,757 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c385de4f6e36b035b666ba4cdfb178ce/family1 in testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:41,757 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5f83dd73746140f4847e71685ff60b9b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/0d199ed057244dd19b7acf9c736f2d0a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/a3a3f54e4a834cd39f80366e3eee0c2f_SeqId_47_] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp, totalSize=178.1 K 2023-12-03 10:55:41,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/63453144b566401280e4a08ced63da6c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/63453144b566401280e4a08ced63da6c 2023-12-03 10:55:41,758 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting 5f83dd73746140f4847e71685ff60b9b, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823227 2023-12-03 10:55:41,759 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting 0d199ed057244dd19b7acf9c736f2d0a, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223227 2023-12-03 10:55:41,761 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] compactions.Compactor(207): Compacting a3a3f54e4a834cd39f80366e3eee0c2f_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223227 2023-12-03 10:55:41,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:55:41,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5d8d85799d3c43409b5af41786ea5cd9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5d8d85799d3c43409b5af41786ea5cd9 2023-12-03 10:55:41,762 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:41,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9c1b372ff3d24b8e8474bc507ef647aa to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9c1b372ff3d24b8e8474bc507ef647aa 2023-12-03 10:55:41,766 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201bf5dba2f10534d28b2383d5e9ee07f25 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201bf5dba2f10534d28b2383d5e9ee07f25 2023-12-03 10:55:41,768 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205097b46c4430044e3a530d2de05c41ca0 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205097b46c4430044e3a530d2de05c41ca0 2023-12-03 10:55:41,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/27a27d6b14344544a7fdfeb53f075c08 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/27a27d6b14344544a7fdfeb53f075c08 2023-12-03 10:55:41,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/1aea0d2a6c5544aea7b5815b2ad14423 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/1aea0d2a6c5544aea7b5815b2ad14423 2023-12-03 10:55:41,770 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228fad1370cf56e4a28872dd14664a7a918 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228fad1370cf56e4a28872dd14664a7a918 2023-12-03 10:55:41,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ce70c8bea4b140038e22b5ed9e5997b7 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ce70c8bea4b140038e22b5ed9e5997b7 2023-12-03 10:55:41,772 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123127799b2cb63e4e71812a358645b59588 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123127799b2cb63e4e71812a358645b59588 2023-12-03 10:55:41,772 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-12-03 10:55:41,772 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-12-03 10:55:41,773 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:55:41,773 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:55:41,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/cca5e57de73e487eaa1d6a7bd0b77699 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/cca5e57de73e487eaa1d6a7bd0b77699 2023-12-03 10:55:41,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/134af0b66cc6422a89c3be049ba3c65d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/134af0b66cc6422a89c3be049ba3c65d 2023-12-03 10:55:41,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ed5bd8fd995146938177ded1c85f639f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/ed5bd8fd995146938177ded1c85f639f 2023-12-03 10:55:41,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9d5119a8dfea4cb2a7783435cfffcd1f_SeqId_44_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/9d5119a8dfea4cb2a7783435cfffcd1f_SeqId_44_ 2023-12-03 10:55:41,820 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] throttle.PressureAwareThroughputController(145): c385de4f6e36b035b666ba4cdfb178ce#family1#compaction#167 average throughput is 4.32 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:41,833 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305b5818b5a8f6474cbb31149534d1ddbc to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511305b5818b5a8f6474cbb31149534d1ddbc 2023-12-03 10:55:41,834 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:55:41,865 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/088696ba0e974d6c9744affec11d0ede first=Optional[r00] last=Optional[r8] 2023-12-03 10:55:41,866 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/088696ba0e974d6c9744affec11d0ede}] 2023-12-03 10:55:41,868 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/088696ba0e974d6c9744affec11d0ede for inclusion in c385de4f6e36b035b666ba4cdfb178ce/family1 2023-12-03 10:55:41,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-12-03 10:55:41,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last= 2023-12-03 10:55:41,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:41,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/088696ba0e974d6c9744affec11d0ede to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5e1h8va1950por36nhhgnpi7c7ojf63i754het304oo8cmqa59h4gn2gf9s5eft8/family1/088696ba0e974d6c9744affec11d0ede 2023-12-03 10:55:41,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5e1h8va1950por36nhhgnpi7c7ojf63i754het304oo8cmqa59h4gn2gf9s5eft8/family1/088696ba0e974d6c9744affec11d0ede as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/872907a36aca4b94b8bf8b4769a281fc_SeqId_49_ 2023-12-03 10:55:41,874 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5e1h8va1950por36nhhgnpi7c7ojf63i754het304oo8cmqa59h4gn2gf9s5eft8/family1/088696ba0e974d6c9744affec11d0ede into c385de4f6e36b035b666ba4cdfb178ce/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/872907a36aca4b94b8bf8b4769a281fc_SeqId_49_ - updating store file list. 2023-12-03 10:55:41,878 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/872907a36aca4b94b8bf8b4769a281fc_SeqId_49_ into c385de4f6e36b035b666ba4cdfb178ce/family1 2023-12-03 10:55:41,878 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5e1h8va1950por36nhhgnpi7c7ojf63i754het304oo8cmqa59h4gn2gf9s5eft8/family1/088696ba0e974d6c9744affec11d0ede into c385de4f6e36b035b666ba4cdfb178ce/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/872907a36aca4b94b8bf8b4769a281fc_SeqId_49_) 2023-12-03 10:55:41,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5e1h8va1950por36nhhgnpi7c7ojf63i754het304oo8cmqa59h4gn2gf9s5eft8/family1/088696ba0e974d6c9744affec11d0ede 2023-12-03 10:55:41,880 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:55:41,881 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:41,882 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511205a77e1a40ca048c9b573b26340d15fd2 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511205a77e1a40ca048c9b573b26340d15fd2 2023-12-03 10:55:41,883 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511289ca46d756dcc4631bd8c84ff43a487a8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511289ca46d756dcc4631bd8c84ff43a487a8 2023-12-03 10:55:41,884 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113032f53e40af404117a313f628acd8038d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113032f53e40af404117a313f628acd8038d 2023-12-03 10:55:41,884 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-12-03 10:55:41,884 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-12-03 10:55:41,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:55:41,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:55:41,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-12-03 10:55:41,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-12-03 10:55:41,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:55:41,888 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-12-03 10:55:41,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.9780 sec 2023-12-03 10:55:42,130 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=260 (was 254) - Thread LEAK? -, OpenFileDescriptor=670 (was 654) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=149 (was 166), ProcessCount=171 (was 171), AvailableMemoryMB=3377 (was 3066) - AvailableMemoryMB LEAK? - 2023-12-03 10:55:42,142 INFO [Listener at localhost/33475] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=260, OpenFileDescriptor=670, MaxFileDescriptor=60000, SystemLoadAverage=149, ProcessCount=171, AvailableMemoryMB=3376 2023-12-03 10:55:42,169 DEBUG [Listener at localhost/33475] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-12-03 10:55:42,242 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/.tmp/family1/df005d29f6c946a2b3ec3e1efa986457 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/df005d29f6c946a2b3ec3e1efa986457 2023-12-03 10:55:42,246 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c385de4f6e36b035b666ba4cdfb178ce/family1 of c385de4f6e36b035b666ba4cdfb178ce into df005d29f6c946a2b3ec3e1efa986457(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:42,246 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:42,246 INFO [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1701600941757; duration=0sec 2023-12-03 10:55:42,246 DEBUG [RS:0;jenkins-hbase4:44259-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-12-03 10:55:42,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xC8M\x86?\xAE\xB4\xF49\x16=\xDCL\xBB\xC0k"\x10o\xE4RN\x8E9M+\x1C\xCB\xD5\x9B@\x1Fl\x13*\x10?\xA2\xF4(/\xF2\x8A\xB2\xCE\x95i'\xBCi\x9D\xA32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-12-03 10:55:42,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure2.ProcedureExecutor(1075): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-12-03 10:55:42,252 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-12-03 10:55:42,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5f83dd73746140f4847e71685ff60b9b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/0d199ed057244dd19b7acf9c736f2d0a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/a3a3f54e4a834cd39f80366e3eee0c2f_SeqId_47_] to archive 2023-12-03 10:55:42,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-12-03 10:55:42,253 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-03 10:55:42,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:42,266 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5f83dd73746140f4847e71685ff60b9b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/5f83dd73746140f4847e71685ff60b9b 2023-12-03 10:55:42,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/0d199ed057244dd19b7acf9c736f2d0a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/0d199ed057244dd19b7acf9c736f2d0a 2023-12-03 10:55:42,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/a3a3f54e4a834cd39f80366e3eee0c2f_SeqId_47_ to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/family1/a3a3f54e4a834cd39f80366e3eee0c2f_SeqId_47_ 2023-12-03 10:55:42,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-12-03 10:55:42,281 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:42,284 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a empty. 2023-12-03 10:55:42,285 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:42,285 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:42,286 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf empty. 2023-12-03 10:55:42,286 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437 2023-12-03 10:55:42,287 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:42,287 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437 empty. 2023-12-03 10:55:42,287 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437 2023-12-03 10:55:42,287 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-12-03 10:55:42,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-12-03 10:55:42,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-12-03 10:55:42,697 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-12-03 10:55:42,707 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 33b2768e307db6deced90abe717d7437, NAME => 'testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xC8M\x86?\xAE\xB4\xF49\x16=\xDCL\xBB\xC0k"\x10o\xE4RN\x8E9M+\x1C\xCB\xD5\x9B@\x1Fl\x13*\x10?\xA2\xF4(/\xF2\x8A\xB2\xCE\x95i'\xBCi\x9D\xA32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:55:42,708 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 902b7511e86b5e6b006adf138dbe176a, NAME => 'testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xC8M\x86?\xAE\xB4\xF49\x16=\xDCL\xBB\xC0k"\x10o\xE4RN\x8E9M+\x1C\xCB\xD5\x9B@\x1Fl\x13*\x10?\xA2\xF4(/\xF2\x8A\xB2\xCE\x95i'\xBCi\x9D\xA32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:55:42,708 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 82b46d94df9a48f2faf6286e289a22cf, NAME => 'testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xC8M\x86?\xAE\xB4\xF49\x16=\xDCL\xBB\xC0k"\x10o\xE4RN\x8E9M+\x1C\xCB\xD5\x9B@\x1Fl\x13*\x10?\xA2\xF4(/\xF2\x8A\xB2\xCE\x95i'\xBCi\x9D\xA32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/.tmp 2023-12-03 10:55:42,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-12-03 10:55:43,131 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:43,131 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 33b2768e307db6deced90abe717d7437, disabling compactions & flushes 2023-12-03 10:55:43,131 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:43,131 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:43,131 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. after waiting 0 ms 2023-12-03 10:55:43,131 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:43,131 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:43,131 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:43,136 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:43,136 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:43,136 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 82b46d94df9a48f2faf6286e289a22cf, disabling compactions & flushes 2023-12-03 10:55:43,136 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 902b7511e86b5e6b006adf138dbe176a, disabling compactions & flushes 2023-12-03 10:55:43,136 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:43,136 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:43,136 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:43,136 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. after waiting 0 ms 2023-12-03 10:55:43,137 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:43,136 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:43,137 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:43,137 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:43,137 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. after waiting 0 ms 2023-12-03 10:55:43,137 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:43,137 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:43,137 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:43,139 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-12-03 10:55:43,140 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600943140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600943140"}]},"ts":"1701600943140"} 2023-12-03 10:55:43,140 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701600943140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600943140"}]},"ts":"1701600943140"} 2023-12-03 10:55:43,140 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600943140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701600943140"}]},"ts":"1701600943140"} 2023-12-03 10:55:43,142 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-12-03 10:55:43,142 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-03 10:55:43,143 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600943142"}]},"ts":"1701600943142"} 2023-12-03 10:55:43,144 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-12-03 10:55:43,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=902b7511e86b5e6b006adf138dbe176a, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=82b46d94df9a48f2faf6286e289a22cf, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=33b2768e307db6deced90abe717d7437, ASSIGN}] 2023-12-03 10:55:43,148 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=82b46d94df9a48f2faf6286e289a22cf, ASSIGN 2023-12-03 10:55:43,148 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=902b7511e86b5e6b006adf138dbe176a, ASSIGN 2023-12-03 10:55:43,148 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=33b2768e307db6deced90abe717d7437, ASSIGN 2023-12-03 10:55:43,149 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=82b46d94df9a48f2faf6286e289a22cf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:55:43,149 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=902b7511e86b5e6b006adf138dbe176a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:55:43,149 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=33b2768e307db6deced90abe717d7437, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44259,1701600798821; forceNewPlan=false, retain=false 2023-12-03 10:55:43,301 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=902b7511e86b5e6b006adf138dbe176a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:43,301 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=33b2768e307db6deced90abe717d7437, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:43,301 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600943301"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600943301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600943301"}]},"ts":"1701600943301"} 2023-12-03 10:55:43,301 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=82b46d94df9a48f2faf6286e289a22cf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:43,301 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600943301"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600943301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600943301"}]},"ts":"1701600943301"} 2023-12-03 10:55:43,301 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701600943301"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701600943301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701600943301"}]},"ts":"1701600943301"} 2023-12-03 10:55:43,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 902b7511e86b5e6b006adf138dbe176a, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:43,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 33b2768e307db6deced90abe717d7437, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:43,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 82b46d94df9a48f2faf6286e289a22cf, server=jenkins-hbase4.apache.org,44259,1701600798821}] 2023-12-03 10:55:43,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-12-03 10:55:43,455 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:43,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:43,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 902b7511e86b5e6b006adf138dbe176a, NAME => 'testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a.', STARTKEY => '', ENDKEY => '1'} 2023-12-03 10:55:43,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:43,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:43,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:43,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:43,480 INFO [StoreOpener-902b7511e86b5e6b006adf138dbe176a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:43,482 DEBUG [StoreOpener-902b7511e86b5e6b006adf138dbe176a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1 2023-12-03 10:55:43,482 DEBUG [StoreOpener-902b7511e86b5e6b006adf138dbe176a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1 2023-12-03 10:55:43,483 INFO [StoreOpener-902b7511e86b5e6b006adf138dbe176a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 902b7511e86b5e6b006adf138dbe176a columnFamilyName family1 2023-12-03 10:55:43,484 INFO [StoreOpener-902b7511e86b5e6b006adf138dbe176a-1] regionserver.HStore(310): Store=902b7511e86b5e6b006adf138dbe176a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:43,484 INFO [StoreOpener-902b7511e86b5e6b006adf138dbe176a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:43,485 DEBUG [StoreOpener-902b7511e86b5e6b006adf138dbe176a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2 2023-12-03 10:55:43,485 DEBUG [StoreOpener-902b7511e86b5e6b006adf138dbe176a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2 2023-12-03 10:55:43,485 INFO [StoreOpener-902b7511e86b5e6b006adf138dbe176a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 902b7511e86b5e6b006adf138dbe176a columnFamilyName family2 2023-12-03 10:55:43,486 INFO [StoreOpener-902b7511e86b5e6b006adf138dbe176a-1] regionserver.HStore(310): Store=902b7511e86b5e6b006adf138dbe176a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:43,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:43,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:43,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:55:43,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:43,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:55:43,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 902b7511e86b5e6b006adf138dbe176a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69635646, jitterRate=0.03765198588371277}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:55:43,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:43,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a., pid=120, masterSystemTime=1701600943455 2023-12-03 10:55:43,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:43,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:43,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:43,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82b46d94df9a48f2faf6286e289a22cf, NAME => 'testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf.', STARTKEY => '1', ENDKEY => '2'} 2023-12-03 10:55:43,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:43,493 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=902b7511e86b5e6b006adf138dbe176a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:43,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:43,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:43,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:43,493 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600943493"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600943493"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600943493"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600943493"}]},"ts":"1701600943493"} 2023-12-03 10:55:43,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=120, resume processing ppid=117 2023-12-03 10:55:43,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 902b7511e86b5e6b006adf138dbe176a, server=jenkins-hbase4.apache.org,44259,1701600798821 in 193 msec 2023-12-03 10:55:43,497 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=902b7511e86b5e6b006adf138dbe176a, ASSIGN in 349 msec 2023-12-03 10:55:43,513 INFO [StoreOpener-82b46d94df9a48f2faf6286e289a22cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:43,514 DEBUG [StoreOpener-82b46d94df9a48f2faf6286e289a22cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1 2023-12-03 10:55:43,514 DEBUG [StoreOpener-82b46d94df9a48f2faf6286e289a22cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1 2023-12-03 10:55:43,515 INFO [StoreOpener-82b46d94df9a48f2faf6286e289a22cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82b46d94df9a48f2faf6286e289a22cf columnFamilyName family1 2023-12-03 10:55:43,515 INFO [StoreOpener-82b46d94df9a48f2faf6286e289a22cf-1] regionserver.HStore(310): Store=82b46d94df9a48f2faf6286e289a22cf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:43,516 INFO [StoreOpener-82b46d94df9a48f2faf6286e289a22cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:43,517 DEBUG [StoreOpener-82b46d94df9a48f2faf6286e289a22cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2 2023-12-03 10:55:43,517 DEBUG [StoreOpener-82b46d94df9a48f2faf6286e289a22cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2 2023-12-03 10:55:43,517 INFO [StoreOpener-82b46d94df9a48f2faf6286e289a22cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82b46d94df9a48f2faf6286e289a22cf columnFamilyName family2 2023-12-03 10:55:43,518 INFO [StoreOpener-82b46d94df9a48f2faf6286e289a22cf-1] regionserver.HStore(310): Store=82b46d94df9a48f2faf6286e289a22cf/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:43,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:43,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:43,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:55:43,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:43,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:55:43,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 82b46d94df9a48f2faf6286e289a22cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59417973, jitterRate=-0.1146032065153122}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:55:43,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:43,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf., pid=121, masterSystemTime=1701600943455 2023-12-03 10:55:43,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:43,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:43,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:43,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 33b2768e307db6deced90abe717d7437, NAME => 'testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437.', STARTKEY => '2', ENDKEY => ''} 2023-12-03 10:55:43,524 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=82b46d94df9a48f2faf6286e289a22cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:43,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 33b2768e307db6deced90abe717d7437 2023-12-03 10:55:43,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-03 10:55:43,524 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701600943524"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600943524"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600943524"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600943524"}]},"ts":"1701600943524"} 2023-12-03 10:55:43,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 33b2768e307db6deced90abe717d7437 2023-12-03 10:55:43,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 33b2768e307db6deced90abe717d7437 2023-12-03 10:55:43,527 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=121, resume processing ppid=118 2023-12-03 10:55:43,527 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 82b46d94df9a48f2faf6286e289a22cf, server=jenkins-hbase4.apache.org,44259,1701600798821 in 222 msec 2023-12-03 10:55:43,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=82b46d94df9a48f2faf6286e289a22cf, ASSIGN in 380 msec 2023-12-03 10:55:43,545 INFO [StoreOpener-33b2768e307db6deced90abe717d7437-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 33b2768e307db6deced90abe717d7437 2023-12-03 10:55:43,546 DEBUG [StoreOpener-33b2768e307db6deced90abe717d7437-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1 2023-12-03 10:55:43,546 DEBUG [StoreOpener-33b2768e307db6deced90abe717d7437-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1 2023-12-03 10:55:43,546 INFO [StoreOpener-33b2768e307db6deced90abe717d7437-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33b2768e307db6deced90abe717d7437 columnFamilyName family1 2023-12-03 10:55:43,547 INFO [StoreOpener-33b2768e307db6deced90abe717d7437-1] regionserver.HStore(310): Store=33b2768e307db6deced90abe717d7437/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:43,547 INFO [StoreOpener-33b2768e307db6deced90abe717d7437-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 33b2768e307db6deced90abe717d7437 2023-12-03 10:55:43,548 DEBUG [StoreOpener-33b2768e307db6deced90abe717d7437-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2 2023-12-03 10:55:43,548 DEBUG [StoreOpener-33b2768e307db6deced90abe717d7437-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2 2023-12-03 10:55:43,548 INFO [StoreOpener-33b2768e307db6deced90abe717d7437-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33b2768e307db6deced90abe717d7437 columnFamilyName family2 2023-12-03 10:55:43,548 INFO [StoreOpener-33b2768e307db6deced90abe717d7437-1] regionserver.HStore(310): Store=33b2768e307db6deced90abe717d7437/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-03 10:55:43,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437 2023-12-03 10:55:43,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437 2023-12-03 10:55:43,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-03 10:55:43,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 33b2768e307db6deced90abe717d7437 2023-12-03 10:55:43,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-03 10:55:43,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 33b2768e307db6deced90abe717d7437; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69042155, jitterRate=0.02880828082561493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-03 10:55:43,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:43,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437., pid=122, masterSystemTime=1701600943455 2023-12-03 10:55:43,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:43,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:43,555 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=33b2768e307db6deced90abe717d7437, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:43,555 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701600943555"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701600943555"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701600943555"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701600943555"}]},"ts":"1701600943555"} 2023-12-03 10:55:43,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=122, resume processing ppid=119 2023-12-03 10:55:43,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 33b2768e307db6deced90abe717d7437, server=jenkins-hbase4.apache.org,44259,1701600798821 in 252 msec 2023-12-03 10:55:43,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=119, resume processing ppid=116 2023-12-03 10:55:43,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=33b2768e307db6deced90abe717d7437, ASSIGN in 410 msec 2023-12-03 10:55:43,559 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-03 10:55:43,559 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701600943559"}]},"ts":"1701600943559"} 2023-12-03 10:55:43,560 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-12-03 10:55:43,562 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-12-03 10:55:43,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.3120 sec 2023-12-03 10:55:44,228 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-12-03 10:55:44,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-12-03 10:55:44,386 INFO [Listener at localhost/33475] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-12-03 10:55:44,392 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:44,392 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:44,392 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:44,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:44,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-12-03 10:55:44,396 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-12-03 10:55:44,396 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:44,396 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-12-03 10:55:44,396 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-12-03 10:55:44,396 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:44,396 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:44,397 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:44,397 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:44,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:44,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:44,398 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:44,398 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:44,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:44,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:44,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:44,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:44,399 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-12-03 10:55:44,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-12-03 10:55:44,402 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-12-03 10:55:44,402 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:44,402 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-12-03 10:55:44,402 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:44,402 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:44,402 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:44,402 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:44,402 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:44,402 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. started... 2023-12-03 10:55:44,402 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. started... 2023-12-03 10:55:44,402 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. started... 2023-12-03 10:55:44,403 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 33b2768e307db6deced90abe717d7437 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-12-03 10:55:44,403 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82b46d94df9a48f2faf6286e289a22cf 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-12-03 10:55:44,403 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 902b7511e86b5e6b006adf138dbe176a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-12-03 10:55:44,456 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312036112e60b7b6040af8b961bae96283e4a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202312036112e60b7b6040af8b961bae96283e4a 2023-12-03 10:55:44,852 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312039c1226c6bde2403ba38f87e7984762a9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202312039c1226c6bde2403ba38f87e7984762a9 2023-12-03 10:55:44,862 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203ee7b39c191d94e838273ed3133a14d80 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231203ee7b39c191d94e838273ed3133a14d80 2023-12-03 10:55:44,866 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/cf5b063fb8b144d0933b60b5fcd38870 2023-12-03 10:55:44,871 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/381792676c3341cf9be48bb87a506785 2023-12-03 10:55:44,883 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/934a0a248f264fb0bfd847db70454c67 2023-12-03 10:55:44,900 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312034e177cc50c604835a41e013cda975d93 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202312034e177cc50c604835a41e013cda975d93 2023-12-03 10:55:44,913 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312034c0f80118bcc4625ba9965a8fb7be516 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202312034c0f80118bcc4625ba9965a8fb7be516 2023-12-03 10:55:44,926 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/fdb877844b064d53a9560ca295a0ec6c 2023-12-03 10:55:44,929 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203b1235d7048a24d969d30abd681b60282 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231203b1235d7048a24d969d30abd681b60282 2023-12-03 10:55:44,930 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/381792676c3341cf9be48bb87a506785 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/381792676c3341cf9be48bb87a506785 2023-12-03 10:55:44,933 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/774955c3c45949fca9a90ee488e93987 2023-12-03 10:55:44,937 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/934a0a248f264fb0bfd847db70454c67 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/934a0a248f264fb0bfd847db70454c67 2023-12-03 10:55:44,956 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/381792676c3341cf9be48bb87a506785, entries=4, sequenceid=5, filesize=5.5 K 2023-12-03 10:55:44,956 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/fdb877844b064d53a9560ca295a0ec6c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/fdb877844b064d53a9560ca295a0ec6c 2023-12-03 10:55:44,960 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/fdb877844b064d53a9560ca295a0ec6c, entries=2, sequenceid=5, filesize=5.1 K 2023-12-03 10:55:44,961 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 902b7511e86b5e6b006adf138dbe176a in 558ms, sequenceid=5, compaction requested=false 2023-12-03 10:55:44,962 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:44,962 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:44,962 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:44,962 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/934a0a248f264fb0bfd847db70454c67, entries=4, sequenceid=5, filesize=5.5 K 2023-12-03 10:55:44,963 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/774955c3c45949fca9a90ee488e93987 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/774955c3c45949fca9a90ee488e93987 2023-12-03 10:55:44,966 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/774955c3c45949fca9a90ee488e93987, entries=2, sequenceid=5, filesize=5.1 K 2023-12-03 10:55:44,967 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 33b2768e307db6deced90abe717d7437 in 564ms, sequenceid=5, compaction requested=false 2023-12-03 10:55:44,967 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:44,967 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:44,967 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:45,308 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/e27a4325f6d845dab9f607f5dca9611f 2023-12-03 10:55:45,312 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/cf5b063fb8b144d0933b60b5fcd38870 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/cf5b063fb8b144d0933b60b5fcd38870 2023-12-03 10:55:45,339 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/cf5b063fb8b144d0933b60b5fcd38870, entries=4, sequenceid=5, filesize=5.5 K 2023-12-03 10:55:45,340 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/e27a4325f6d845dab9f607f5dca9611f as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e27a4325f6d845dab9f607f5dca9611f 2023-12-03 10:55:45,343 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e27a4325f6d845dab9f607f5dca9611f, entries=2, sequenceid=5, filesize=5.1 K 2023-12-03 10:55:45,344 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 82b46d94df9a48f2faf6286e289a22cf in 941ms, sequenceid=5, compaction requested=false 2023-12-03 10:55:45,344 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:45,344 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:45,344 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:45,344 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:45,344 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,344 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-12-03 10:55:45,344 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-12-03 10:55:45,346 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,346 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:45,346 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:45,346 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:45,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-12-03 10:55:45,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@281502e5[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:45,347 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-12-03 10:55:45,348 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:45,348 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:45,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:45,349 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-12-03 10:55:45,349 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-12-03 10:55:45,349 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:45,349 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,349 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:45,350 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-12-03 10:55:45,350 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,350 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:45,350 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-12-03 10:55:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:45,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-12-03 10:55:45,353 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-12-03 10:55:45,353 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:45,353 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:45,353 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-12-03 10:55:45,353 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:45,357 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:45,357 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:45,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:45,357 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:45,357 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:45,359 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:45,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,361 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,361 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:45,361 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:45,361 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:45,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:45,361 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,361 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:45,361 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:45,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-12-03 10:55:45,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-12-03 10:55:45,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:45,361 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:45,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:45,361 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:45,361 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:45,362 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:45,362 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:45,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:45,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:45,462 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:45,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:45,464 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:45,464 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:45,464 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:45,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:45,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:45,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-12-03 10:55:45,468 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-12-03 10:55:45,468 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:45,468 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-12-03 10:55:45,468 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-12-03 10:55:45,469 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:45,469 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:45,470 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:45,470 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:45,470 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:45,470 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:45,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:45,471 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-12-03 10:55:45,471 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-12-03 10:55:45,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-12-03 10:55:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-12-03 10:55:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-12-03 10:55:45,472 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:45,472 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. started... 2023-12-03 10:55:45,472 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:45,472 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:45,472 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82b46d94df9a48f2faf6286e289a22cf 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-12-03 10:55:45,472 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. started... 2023-12-03 10:55:45,472 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. started... 2023-12-03 10:55:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:45,472 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 902b7511e86b5e6b006adf138dbe176a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-12-03 10:55:45,472 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 33b2768e307db6deced90abe717d7437 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-12-03 10:55:45,522 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312039a28a0347afb48e79c7e8e888a323366 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202312039a28a0347afb48e79c7e8e888a323366 2023-12-03 10:55:45,525 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023120355cbf023be2149e2af7bba2d3d102a9f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023120355cbf023be2149e2af7bba2d3d102a9f 2023-12-03 10:55:45,527 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312037f41c5516e3c40be8a2ad25dffab0356 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202312037f41c5516e3c40be8a2ad25dffab0356 2023-12-03 10:55:45,547 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/11626f328b33496e90ee9e967a053933 2023-12-03 10:55:45,938 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/d6904320889246fa9b7ca23649ccdcdf 2023-12-03 10:55:45,960 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/f83bb3e8c3b3430f86410444d9a7e1d1 2023-12-03 10:55:45,972 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203bfe350f49e8248c2ab14642f5a32d874 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231203bfe350f49e8248c2ab14642f5a32d874 2023-12-03 10:55:45,981 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023120318aefbad12cf451480cb27c87543647d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023120318aefbad12cf451480cb27c87543647d 2023-12-03 10:55:45,986 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/f0a2c1b7fc544a1b88407ddc54c95748 2023-12-03 10:55:45,989 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/11626f328b33496e90ee9e967a053933 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/11626f328b33496e90ee9e967a053933 2023-12-03 10:55:45,991 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312032ddc99ce23a745ccaf08b07bdea1ffde to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202312032ddc99ce23a745ccaf08b07bdea1ffde 2023-12-03 10:55:45,994 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/c914de935f4f4415880cb5edd54d000b 2023-12-03 10:55:45,998 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/f83bb3e8c3b3430f86410444d9a7e1d1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/f83bb3e8c3b3430f86410444d9a7e1d1 2023-12-03 10:55:46,012 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/11626f328b33496e90ee9e967a053933, entries=4, sequenceid=9, filesize=5.5 K 2023-12-03 10:55:46,012 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/f0a2c1b7fc544a1b88407ddc54c95748 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/f0a2c1b7fc544a1b88407ddc54c95748 2023-12-03 10:55:46,015 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/f0a2c1b7fc544a1b88407ddc54c95748, entries=2, sequenceid=9, filesize=5.1 K 2023-12-03 10:55:46,015 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 33b2768e307db6deced90abe717d7437 in 543ms, sequenceid=9, compaction requested=false 2023-12-03 10:55:46,015 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:46,015 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:46,016 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:46,020 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/f83bb3e8c3b3430f86410444d9a7e1d1, entries=4, sequenceid=9, filesize=5.5 K 2023-12-03 10:55:46,021 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/c914de935f4f4415880cb5edd54d000b as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/c914de935f4f4415880cb5edd54d000b 2023-12-03 10:55:46,023 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/c914de935f4f4415880cb5edd54d000b, entries=2, sequenceid=9, filesize=5.1 K 2023-12-03 10:55:46,024 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 902b7511e86b5e6b006adf138dbe176a in 552ms, sequenceid=9, compaction requested=false 2023-12-03 10:55:46,024 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:46,024 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:46,024 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:46,377 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/c585d59313d940f2bc9e819d9321885a 2023-12-03 10:55:46,381 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/d6904320889246fa9b7ca23649ccdcdf as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/d6904320889246fa9b7ca23649ccdcdf 2023-12-03 10:55:46,415 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/d6904320889246fa9b7ca23649ccdcdf, entries=4, sequenceid=9, filesize=5.5 K 2023-12-03 10:55:46,416 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/c585d59313d940f2bc9e819d9321885a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/c585d59313d940f2bc9e819d9321885a 2023-12-03 10:55:46,442 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/c585d59313d940f2bc9e819d9321885a, entries=2, sequenceid=9, filesize=5.1 K 2023-12-03 10:55:46,443 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:55:46,443 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 82b46d94df9a48f2faf6286e289a22cf in 971ms, sequenceid=9, compaction requested=false 2023-12-03 10:55:46,443 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b900934 to 127.0.0.1:62442 2023-12-03 10:55:46,443 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:46,443 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:55:46,443 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:46,443 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:55:46,443 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20748126 to 127.0.0.1:62442 2023-12-03 10:55:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:46,443 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:55:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-12-03 10:55:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-12-03 10:55:46,446 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,447 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:46,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:46,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:46,447 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:46,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:46,447 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:46,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:46,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-12-03 10:55:46,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36c19bd1[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:46,449 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-12-03 10:55:46,449 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:46,452 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:46,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:46,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:46,452 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-12-03 10:55:46,452 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-12-03 10:55:46,452 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:46,452 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,452 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:46,453 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-12-03 10:55:46,453 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,453 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:46,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:46,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:46,453 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-12-03 10:55:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:46,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:46,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:46,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-12-03 10:55:46,456 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-12-03 10:55:46,456 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:46,456 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:46,456 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-12-03 10:55:46,456 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:46,457 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:46,457 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:46,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:46,457 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:46,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:46,458 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:46,459 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:46,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:46,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,461 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,462 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:46,462 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:46,462 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:46,462 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:46,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-12-03 10:55:46,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:46,462 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:46,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-12-03 10:55:46,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:46,462 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,462 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:46,462 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:46,462 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:46,462 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:46,462 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:46,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:46,562 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:46,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:46,564 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:46,564 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:46,565 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:46,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:46,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:46,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-12-03 10:55:46,569 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-12-03 10:55:46,569 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:46,569 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-12-03 10:55:46,569 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-12-03 10:55:46,569 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:46,569 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:46,571 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:46,571 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:46,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:46,572 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:46,572 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:46,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:46,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:46,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:46,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:46,575 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-12-03 10:55:46,575 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-12-03 10:55:46,575 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-12-03 10:55:46,575 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-12-03 10:55:46,575 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:46,575 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-12-03 10:55:46,576 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:46,576 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. started... 2023-12-03 10:55:46,576 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:46,576 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. started... 2023-12-03 10:55:46,576 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82b46d94df9a48f2faf6286e289a22cf 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-12-03 10:55:46,576 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 902b7511e86b5e6b006adf138dbe176a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-12-03 10:55:46,577 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:46,577 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:46,577 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:46,577 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. started... 2023-12-03 10:55:46,577 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 33b2768e307db6deced90abe717d7437 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-12-03 10:55:47,027 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203eddcf1ca8d9c4425b1e1014d710fdce9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231203eddcf1ca8d9c4425b1e1014d710fdce9 2023-12-03 10:55:47,032 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312038fed0210237847358ff0e0877a95b722 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202312038fed0210237847358ff0e0877a95b722 2023-12-03 10:55:47,033 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312036bf02d6bd99343ad809eaae4a4c0b834 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202312036bf02d6bd99343ad809eaae4a4c0b834 2023-12-03 10:55:47,042 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/c93d75b540ec4b7ca168a7de6e350a64 2023-12-03 10:55:47,048 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/bba8af45c0ac4a05b0937c2de216de80 2023-12-03 10:55:47,050 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/7e4d330c2a4c491a8a97c77cca31428a 2023-12-03 10:55:47,486 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312030f5656fa78ba4522879a5be958f247b3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202312030f5656fa78ba4522879a5be958f247b3 2023-12-03 10:55:47,500 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203d06d6bd08b6d46d2a52026bbf65a713e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231203d06d6bd08b6d46d2a52026bbf65a713e 2023-12-03 10:55:47,500 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312033a9c880b13164d9aaa0c68e5a7eaebc8 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202312033a9c880b13164d9aaa0c68e5a7eaebc8 2023-12-03 10:55:47,504 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/4b6920cbe8cc4d109b59045c204b527c 2023-12-03 10:55:47,507 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/7e4d330c2a4c491a8a97c77cca31428a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/7e4d330c2a4c491a8a97c77cca31428a 2023-12-03 10:55:47,530 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/7e4d330c2a4c491a8a97c77cca31428a, entries=4, sequenceid=13, filesize=5.5 K 2023-12-03 10:55:47,531 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/4b6920cbe8cc4d109b59045c204b527c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/4b6920cbe8cc4d109b59045c204b527c 2023-12-03 10:55:47,534 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/4b6920cbe8cc4d109b59045c204b527c, entries=2, sequenceid=13, filesize=5.1 K 2023-12-03 10:55:47,534 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 33b2768e307db6deced90abe717d7437 in 957ms, sequenceid=13, compaction requested=true 2023-12-03 10:55:47,534 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:47,534 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:47,535 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:47,891 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/14b9338369a54e208ad16b8e4ba60d40 2023-12-03 10:55:47,896 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/c93d75b540ec4b7ca168a7de6e350a64 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/c93d75b540ec4b7ca168a7de6e350a64 2023-12-03 10:55:47,905 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/ca9a44c251334497a25fdf362c22e81f 2023-12-03 10:55:47,908 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/bba8af45c0ac4a05b0937c2de216de80 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/bba8af45c0ac4a05b0937c2de216de80 2023-12-03 10:55:47,920 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/c93d75b540ec4b7ca168a7de6e350a64, entries=4, sequenceid=13, filesize=5.5 K 2023-12-03 10:55:47,921 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/14b9338369a54e208ad16b8e4ba60d40 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/14b9338369a54e208ad16b8e4ba60d40 2023-12-03 10:55:47,925 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/14b9338369a54e208ad16b8e4ba60d40, entries=2, sequenceid=13, filesize=5.1 K 2023-12-03 10:55:47,926 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 902b7511e86b5e6b006adf138dbe176a in 1350ms, sequenceid=13, compaction requested=true 2023-12-03 10:55:47,926 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:47,926 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:47,926 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:47,931 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/bba8af45c0ac4a05b0937c2de216de80, entries=4, sequenceid=13, filesize=5.5 K 2023-12-03 10:55:47,932 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/ca9a44c251334497a25fdf362c22e81f as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/ca9a44c251334497a25fdf362c22e81f 2023-12-03 10:55:47,935 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/ca9a44c251334497a25fdf362c22e81f, entries=2, sequenceid=13, filesize=5.1 K 2023-12-03 10:55:47,935 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 82b46d94df9a48f2faf6286e289a22cf in 1359ms, sequenceid=13, compaction requested=true 2023-12-03 10:55:47,935 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:47,935 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:47,935 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:47,935 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:47,936 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,936 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-12-03 10:55:47,936 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-12-03 10:55:47,937 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:47,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-12-03 10:55:47,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38ba4332[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:47,939 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-12-03 10:55:47,939 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:47,941 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:47,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:47,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:47,941 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-12-03 10:55:47,941 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-12-03 10:55:47,941 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:47,941 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,941 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:47,942 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-12-03 10:55:47,942 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:47,942 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,942 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-12-03 10:55:47,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:47,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:47,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-12-03 10:55:47,944 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-12-03 10:55:47,944 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:47,944 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:47,945 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-12-03 10:55:47,945 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:47,946 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:47,946 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:47,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:47,946 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:47,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:47,946 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:47,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:47,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:47,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:47,947 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,949 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,950 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:47,950 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:47,950 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:47,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:47,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-12-03 10:55:47,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:47,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-12-03 10:55:47,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:47,950 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:47,950 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:47,950 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:47,950 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:47,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:47,950 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:47,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:47,950 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:47,950 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:47,950 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:48,050 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:48,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:48,052 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:48,052 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:48,052 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. with WAL disabled. Data may be lost in the event of a crash. 2023-12-03 10:55:48,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:48,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:48,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-12-03 10:55:48,057 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-12-03 10:55:48,057 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:48,057 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-12-03 10:55:48,057 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-12-03 10:55:48,058 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:48,058 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:48,060 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:48,060 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:48,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:48,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:48,060 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:48,060 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:48,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:48,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:48,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:48,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:48,061 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-12-03 10:55:48,061 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-12-03 10:55:48,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-12-03 10:55:48,061 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-12-03 10:55:48,061 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:48,061 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-12-03 10:55:48,061 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:48,061 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. started... 2023-12-03 10:55:48,061 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82b46d94df9a48f2faf6286e289a22cf 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-12-03 10:55:48,063 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:48,063 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:48,063 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:48,063 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:48,063 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. started... 2023-12-03 10:55:48,063 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. started... 2023-12-03 10:55:48,063 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 902b7511e86b5e6b006adf138dbe176a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-12-03 10:55:48,063 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 33b2768e307db6deced90abe717d7437 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-12-03 10:55:48,117 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203a6a9279baf994f1e8849995e7e4e21b9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231203a6a9279baf994f1e8849995e7e4e21b9 2023-12-03 10:55:48,133 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/9518a4a25064462eb25d31bd0f6eb171 2023-12-03 10:55:48,164 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231203254b9b0a61254429899278f9e8d77b1e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231203254b9b0a61254429899278f9e8d77b1e 2023-12-03 10:55:48,168 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/eff429c619014689abc6641d8205547c 2023-12-03 10:55:48,173 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/9518a4a25064462eb25d31bd0f6eb171 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/9518a4a25064462eb25d31bd0f6eb171 2023-12-03 10:55:48,200 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/9518a4a25064462eb25d31bd0f6eb171, entries=4, sequenceid=17, filesize=5.5 K 2023-12-03 10:55:48,200 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/eff429c619014689abc6641d8205547c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/eff429c619014689abc6641d8205547c 2023-12-03 10:55:48,204 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/eff429c619014689abc6641d8205547c, entries=2, sequenceid=17, filesize=5.1 K 2023-12-03 10:55:48,205 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 902b7511e86b5e6b006adf138dbe176a in 142ms, sequenceid=17, compaction requested=true 2023-12-03 10:55:48,205 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:48,205 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:48,205 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:48,510 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203c662531e8bfb4165a5ba17b0603c677e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231203c662531e8bfb4165a5ba17b0603c677e 2023-12-03 10:55:48,524 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203c5b399e65c14405aa8dd23b7477a5884 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231203c5b399e65c14405aa8dd23b7477a5884 2023-12-03 10:55:48,930 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/0d4225e81f6d44b599b90ebf18060359 2023-12-03 10:55:48,940 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/3a2aec8617924f598cf4d77899d39a30 2023-12-03 10:55:48,970 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202312032cc65e1193134f72b682d6879448c930 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202312032cc65e1193134f72b682d6879448c930 2023-12-03 10:55:48,987 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/2b13ff73f8a3466292c7d210cb7b953a 2023-12-03 10:55:48,991 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/0d4225e81f6d44b599b90ebf18060359 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0d4225e81f6d44b599b90ebf18060359 2023-12-03 10:55:48,991 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203f4a29c1b174740549479abdf2d8cb518 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231203f4a29c1b174740549479abdf2d8cb518 2023-12-03 10:55:48,999 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-03 10:55:49,028 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0d4225e81f6d44b599b90ebf18060359, entries=4, sequenceid=17, filesize=5.5 K 2023-12-03 10:55:49,028 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/2b13ff73f8a3466292c7d210cb7b953a as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/2b13ff73f8a3466292c7d210cb7b953a 2023-12-03 10:55:49,032 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/2b13ff73f8a3466292c7d210cb7b953a, entries=2, sequenceid=17, filesize=5.1 K 2023-12-03 10:55:49,033 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 82b46d94df9a48f2faf6286e289a22cf in 972ms, sequenceid=17, compaction requested=true 2023-12-03 10:55:49,033 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:49,033 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:49,033 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:49,397 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/3148a9c20da148a19a9f54ba28589ce3 2023-12-03 10:55:49,401 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/3a2aec8617924f598cf4d77899d39a30 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/3a2aec8617924f598cf4d77899d39a30 2023-12-03 10:55:49,426 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/3a2aec8617924f598cf4d77899d39a30, entries=4, sequenceid=17, filesize=5.5 K 2023-12-03 10:55:49,427 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/3148a9c20da148a19a9f54ba28589ce3 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/3148a9c20da148a19a9f54ba28589ce3 2023-12-03 10:55:49,431 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/3148a9c20da148a19a9f54ba28589ce3, entries=2, sequenceid=17, filesize=5.1 K 2023-12-03 10:55:49,432 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 33b2768e307db6deced90abe717d7437 in 1369ms, sequenceid=17, compaction requested=true 2023-12-03 10:55:49,432 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:49,432 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:49,432 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:49,432 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:49,432 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,432 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-12-03 10:55:49,432 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-12-03 10:55:49,435 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:49,435 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:49,436 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:49,436 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:49,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:49,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:49,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-12-03 10:55:49,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f6d997e[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:49,437 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-12-03 10:55:49,437 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:49,441 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:49,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:49,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:49,441 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-12-03 10:55:49,441 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,441 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:49,441 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-12-03 10:55:49,441 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:49,443 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-12-03 10:55:49,443 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,443 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:49,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:49,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:49,443 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-12-03 10:55:49,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:49,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:49,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:49,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:49,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:49,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:49,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-12-03 10:55:49,445 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-12-03 10:55:49,445 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:49,445 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:49,445 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-12-03 10:55:49,445 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:49,448 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:49,448 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:49,448 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:49,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:49,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:49,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:49,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:49,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:49,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:49,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:49,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:49,449 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:49,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:49,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:49,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:49,450 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:49,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:49,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,453 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,453 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:49,453 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:49,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:49,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-12-03 10:55:49,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:49,453 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:49,453 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:49,453 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:49,453 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,453 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:49,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:49,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-12-03 10:55:49,453 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:49,453 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:49,454 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:49,454 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:49,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:49,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:49,554 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:49,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:49,562 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:49,571 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:49,580 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:49,581 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:49,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-12-03 10:55:49,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-12-03 10:55:49,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-12-03 10:55:49,718 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-12-03 10:55:49,718 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:49,718 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-12-03 10:55:49,718 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-12-03 10:55:49,718 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:49,718 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:49,720 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:49,720 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:49,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:49,721 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:49,721 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-12-03 10:55:49,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:49,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:49,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-12-03 10:55:49,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:49,722 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-12-03 10:55:49,722 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-12-03 10:55:49,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-12-03 10:55:49,722 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-12-03 10:55:49,722 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-12-03 10:55:49,722 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-12-03 10:55:49,723 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:49,723 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. started... 2023-12-03 10:55:49,723 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-12-03 10:55:49,723 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:49,723 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82b46d94df9a48f2faf6286e289a22cf 2/2 column families, dataSize=138 B heapSize=944 B 2023-12-03 10:55:49,723 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:49,723 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-12-03 10:55:49,723 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. started... 2023-12-03 10:55:49,723 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. started... 2023-12-03 10:55:49,723 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 33b2768e307db6deced90abe717d7437 2/2 column families, dataSize=138 B heapSize=944 B 2023-12-03 10:55:49,723 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 902b7511e86b5e6b006adf138dbe176a 2/2 column families, dataSize=138 B heapSize=944 B 2023-12-03 10:55:49,771 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/7b39762358a74a5985ba1b7acfa76dc3 2023-12-03 10:55:49,777 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/8f9be3d8bba249d584cd96e1dd8d0e00 2023-12-03 10:55:49,793 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b39762358a74a5985ba1b7acfa76dc3 2023-12-03 10:55:49,803 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f9be3d8bba249d584cd96e1dd8d0e00 2023-12-03 10:55:49,829 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/120aa9b8dd9b4b2b9374b1cd02283f8c 2023-12-03 10:55:49,832 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 120aa9b8dd9b4b2b9374b1cd02283f8c 2023-12-03 10:55:49,833 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/8f9be3d8bba249d584cd96e1dd8d0e00 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/8f9be3d8bba249d584cd96e1dd8d0e00 2023-12-03 10:55:49,859 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f9be3d8bba249d584cd96e1dd8d0e00 2023-12-03 10:55:49,859 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/8f9be3d8bba249d584cd96e1dd8d0e00, entries=3, sequenceid=23, filesize=5.2 K 2023-12-03 10:55:49,860 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/120aa9b8dd9b4b2b9374b1cd02283f8c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/120aa9b8dd9b4b2b9374b1cd02283f8c 2023-12-03 10:55:49,863 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 120aa9b8dd9b4b2b9374b1cd02283f8c 2023-12-03 10:55:49,863 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/120aa9b8dd9b4b2b9374b1cd02283f8c, entries=1, sequenceid=23, filesize=5.0 K 2023-12-03 10:55:49,864 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 33b2768e307db6deced90abe717d7437 in 141ms, sequenceid=23, compaction requested=true 2023-12-03 10:55:49,864 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:49,864 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:49,864 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-12-03 10:55:50,165 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/0919a7401a824c40844ec404002f8424 2023-12-03 10:55:50,197 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0919a7401a824c40844ec404002f8424 2023-12-03 10:55:50,221 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/75ad5fa0d0d5443583659236c04bc0bb 2023-12-03 10:55:50,224 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75ad5fa0d0d5443583659236c04bc0bb 2023-12-03 10:55:50,225 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/7b39762358a74a5985ba1b7acfa76dc3 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/7b39762358a74a5985ba1b7acfa76dc3 2023-12-03 10:55:50,255 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b39762358a74a5985ba1b7acfa76dc3 2023-12-03 10:55:50,255 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/7b39762358a74a5985ba1b7acfa76dc3, entries=3, sequenceid=23, filesize=5.2 K 2023-12-03 10:55:50,256 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/75ad5fa0d0d5443583659236c04bc0bb as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/75ad5fa0d0d5443583659236c04bc0bb 2023-12-03 10:55:50,259 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75ad5fa0d0d5443583659236c04bc0bb 2023-12-03 10:55:50,259 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/75ad5fa0d0d5443583659236c04bc0bb, entries=1, sequenceid=23, filesize=5.0 K 2023-12-03 10:55:50,260 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 902b7511e86b5e6b006adf138dbe176a in 537ms, sequenceid=23, compaction requested=true 2023-12-03 10:55:50,260 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:50,260 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:50,260 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-12-03 10:55:50,613 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/e5eca5cf56f648d785da3e8bd8d6bb09 2023-12-03 10:55:50,617 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5eca5cf56f648d785da3e8bd8d6bb09 2023-12-03 10:55:50,618 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/0919a7401a824c40844ec404002f8424 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0919a7401a824c40844ec404002f8424 2023-12-03 10:55:50,643 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0919a7401a824c40844ec404002f8424 2023-12-03 10:55:50,643 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0919a7401a824c40844ec404002f8424, entries=3, sequenceid=23, filesize=5.2 K 2023-12-03 10:55:50,643 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/e5eca5cf56f648d785da3e8bd8d6bb09 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e5eca5cf56f648d785da3e8bd8d6bb09 2023-12-03 10:55:50,647 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5eca5cf56f648d785da3e8bd8d6bb09 2023-12-03 10:55:50,647 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e5eca5cf56f648d785da3e8bd8d6bb09, entries=1, sequenceid=23, filesize=5.0 K 2023-12-03 10:55:50,648 INFO [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 82b46d94df9a48f2faf6286e289a22cf in 925ms, sequenceid=23, compaction requested=true 2023-12-03 10:55:50,648 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:50,648 DEBUG [rs(jenkins-hbase4.apache.org,44259,1701600798821)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:50,648 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-12-03 10:55:50,648 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-12-03 10:55:50,648 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,648 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-12-03 10:55:50,648 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-12-03 10:55:50,650 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,650 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:50,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:50,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:50,650 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:50,651 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-12-03 10:55:50,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:50,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:50,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:50,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:50,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44259,1701600798821' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-12-03 10:55:50,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f6fbc5c[Count = 0] remaining members to acquire global barrier 2023-12-03 10:55:50,652 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-12-03 10:55:50,652 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:50,653 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:50,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:50,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:50,653 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-12-03 10:55:50,653 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-12-03 10:55:50,653 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44259,1701600798821' in zk 2023-12-03 10:55:50,653 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,654 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-12-03 10:55:50,656 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-12-03 10:55:50,656 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,656 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:50,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:50,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:50,656 DEBUG [member: 'jenkins-hbase4.apache.org,44259,1701600798821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-12-03 10:55:50,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:50,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:50,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:50,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:50,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:50,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44259,1701600798821': 2023-12-03 10:55:50,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44259,1701600798821' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-12-03 10:55:50,658 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-12-03 10:55:50,658 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-12-03 10:55:50,658 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-12-03 10:55:50,658 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-12-03 10:55:50,658 INFO [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-12-03 10:55:50,660 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:50,660 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-12-03 10:55:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-12-03 10:55:50,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:50,660 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-12-03 10:55:50,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:50,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:50,661 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:50,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:50,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-12-03 10:55:50,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:50,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,662 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-12-03 10:55:50,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-12-03 10:55:50,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,664 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,664 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-12-03 10:55:50,664 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:50,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-12-03 10:55:50,664 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-12-03 10:55:50,664 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-12-03 10:55:50,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-12-03 10:55:50,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-12-03 10:55:50,664 DEBUG [(jenkins-hbase4.apache.org,46307,1701600797605)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-12-03 10:55:50,664 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:50,665 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:50,665 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-12-03 10:55:50,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-03 10:55:50,665 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-12-03 10:55:50,665 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-12-03 10:55:50,665 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-12-03 10:55:50,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-12-03 10:55:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-03 10:55:50,765 DEBUG [Listener at localhost/33475] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-12-03 10:55:50,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46307] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-12-03 10:55:50,766 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:50,766 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 82b46d94df9a48f2faf6286e289a22cf/family1 is initiating major compaction (all files) 2023-12-03 10:55:50,766 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:50,767 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:50,767 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 82b46d94df9a48f2faf6286e289a22cf/family1 in testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:50,767 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/cf5b063fb8b144d0933b60b5fcd38870, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/d6904320889246fa9b7ca23649ccdcdf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/bba8af45c0ac4a05b0937c2de216de80, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0d4225e81f6d44b599b90ebf18060359, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0919a7401a824c40844ec404002f8424] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp, totalSize=27.1 K 2023-12-03 10:55:50,767 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting cf5b063fb8b144d0933b60b5fcd38870, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600944392 2023-12-03 10:55:50,768 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting d6904320889246fa9b7ca23649ccdcdf, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600945464 2023-12-03 10:55:50,768 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting bba8af45c0ac4a05b0937c2de216de80, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600946564 2023-12-03 10:55:50,769 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 0d4225e81f6d44b599b90ebf18060359, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600948052 2023-12-03 10:55:50,769 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 0919a7401a824c40844ec404002f8424, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:50,778 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 82b46d94df9a48f2faf6286e289a22cf#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:51,225 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231203282b94c54e2f49e5a83e33a3dc1d3909_del 2023-12-03 10:55:51,225 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203282b94c54e2f49e5a83e33a3dc1d3909_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231203282b94c54e2f49e5a83e33a3dc1d3909_del 2023-12-03 10:55:51,278 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3b036d41de77456788cf4dd9eb8fc6e3 2023-12-03 10:55:51,278 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family1/3b036d41de77456788cf4dd9eb8fc6e3 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/3b036d41de77456788cf4dd9eb8fc6e3 2023-12-03 10:55:51,299 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3b036d41de77456788cf4dd9eb8fc6e3 2023-12-03 10:55:51,300 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 82b46d94df9a48f2faf6286e289a22cf/family1 of 82b46d94df9a48f2faf6286e289a22cf into 3b036d41de77456788cf4dd9eb8fc6e3(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:51,300 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:51,300 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:51,300 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 82b46d94df9a48f2faf6286e289a22cf/family2 is initiating major compaction (all files) 2023-12-03 10:55:51,301 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:51,301 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:51,301 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 82b46d94df9a48f2faf6286e289a22cf/family2 in testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:51,302 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e27a4325f6d845dab9f607f5dca9611f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/c585d59313d940f2bc9e819d9321885a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/ca9a44c251334497a25fdf362c22e81f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/2b13ff73f8a3466292c7d210cb7b953a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e5eca5cf56f648d785da3e8bd8d6bb09] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp, totalSize=25.4 K 2023-12-03 10:55:51,302 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting e27a4325f6d845dab9f607f5dca9611f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600944392 2023-12-03 10:55:51,302 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting c585d59313d940f2bc9e819d9321885a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600945464 2023-12-03 10:55:51,303 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting ca9a44c251334497a25fdf362c22e81f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600946564 2023-12-03 10:55:51,303 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 2b13ff73f8a3466292c7d210cb7b953a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600948052 2023-12-03 10:55:51,303 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting e5eca5cf56f648d785da3e8bd8d6bb09, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:51,311 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 82b46d94df9a48f2faf6286e289a22cf#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:51,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/cf5b063fb8b144d0933b60b5fcd38870, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/d6904320889246fa9b7ca23649ccdcdf, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/bba8af45c0ac4a05b0937c2de216de80, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0d4225e81f6d44b599b90ebf18060359, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0919a7401a824c40844ec404002f8424] to archive 2023-12-03 10:55:51,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:51,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/cf5b063fb8b144d0933b60b5fcd38870 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/cf5b063fb8b144d0933b60b5fcd38870 2023-12-03 10:55:51,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/d6904320889246fa9b7ca23649ccdcdf to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/d6904320889246fa9b7ca23649ccdcdf 2023-12-03 10:55:51,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/bba8af45c0ac4a05b0937c2de216de80 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/bba8af45c0ac4a05b0937c2de216de80 2023-12-03 10:55:51,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0d4225e81f6d44b599b90ebf18060359 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0d4225e81f6d44b599b90ebf18060359 2023-12-03 10:55:51,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0919a7401a824c40844ec404002f8424 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/0919a7401a824c40844ec404002f8424 2023-12-03 10:55:51,718 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231203f168a14b3b4f4b628de271206dc638cb_del 2023-12-03 10:55:51,718 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231203f168a14b3b4f4b628de271206dc638cb_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231203f168a14b3b4f4b628de271206dc638cb_del 2023-12-03 10:55:52,130 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78c5566ef3a548969794880e7d629917 2023-12-03 10:55:52,131 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/.tmp/family2/78c5566ef3a548969794880e7d629917 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/78c5566ef3a548969794880e7d629917 2023-12-03 10:55:52,134 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78c5566ef3a548969794880e7d629917 2023-12-03 10:55:52,135 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 82b46d94df9a48f2faf6286e289a22cf/family2 of 82b46d94df9a48f2faf6286e289a22cf into 78c5566ef3a548969794880e7d629917(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:52,135 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:52,135 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:52,135 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 902b7511e86b5e6b006adf138dbe176a/family1 is initiating major compaction (all files) 2023-12-03 10:55:52,136 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:52,136 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:52,137 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 902b7511e86b5e6b006adf138dbe176a/family1 in testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:52,137 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/381792676c3341cf9be48bb87a506785, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/f83bb3e8c3b3430f86410444d9a7e1d1, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/c93d75b540ec4b7ca168a7de6e350a64, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/9518a4a25064462eb25d31bd0f6eb171, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/7b39762358a74a5985ba1b7acfa76dc3] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp, totalSize=27.1 K 2023-12-03 10:55:52,138 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 381792676c3341cf9be48bb87a506785, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600944391 2023-12-03 10:55:52,138 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting f83bb3e8c3b3430f86410444d9a7e1d1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600945464 2023-12-03 10:55:52,138 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting c93d75b540ec4b7ca168a7de6e350a64, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600946564 2023-12-03 10:55:52,138 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 9518a4a25064462eb25d31bd0f6eb171, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600948052 2023-12-03 10:55:52,139 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 7b39762358a74a5985ba1b7acfa76dc3, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:52,147 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 902b7511e86b5e6b006adf138dbe176a#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:52,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e27a4325f6d845dab9f607f5dca9611f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/c585d59313d940f2bc9e819d9321885a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/ca9a44c251334497a25fdf362c22e81f, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/2b13ff73f8a3466292c7d210cb7b953a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e5eca5cf56f648d785da3e8bd8d6bb09] to archive 2023-12-03 10:55:52,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:52,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e27a4325f6d845dab9f607f5dca9611f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e27a4325f6d845dab9f607f5dca9611f 2023-12-03 10:55:52,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/c585d59313d940f2bc9e819d9321885a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/c585d59313d940f2bc9e819d9321885a 2023-12-03 10:55:52,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/ca9a44c251334497a25fdf362c22e81f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/ca9a44c251334497a25fdf362c22e81f 2023-12-03 10:55:52,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/2b13ff73f8a3466292c7d210cb7b953a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/2b13ff73f8a3466292c7d210cb7b953a 2023-12-03 10:55:52,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e5eca5cf56f648d785da3e8bd8d6bb09 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family2/e5eca5cf56f648d785da3e8bd8d6bb09 2023-12-03 10:55:52,588 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202312032e3944e85e894fdfa16e78c7081109b1_del 2023-12-03 10:55:52,588 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202312032e3944e85e894fdfa16e78c7081109b1_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202312032e3944e85e894fdfa16e78c7081109b1_del 2023-12-03 10:55:53,440 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fcc4381dcd2449f82e18840e8ebc277 2023-12-03 10:55:53,441 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family1/6fcc4381dcd2449f82e18840e8ebc277 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/6fcc4381dcd2449f82e18840e8ebc277 2023-12-03 10:55:53,462 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fcc4381dcd2449f82e18840e8ebc277 2023-12-03 10:55:53,462 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 902b7511e86b5e6b006adf138dbe176a/family1 of 902b7511e86b5e6b006adf138dbe176a into 6fcc4381dcd2449f82e18840e8ebc277(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:53,463 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:53,463 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:53,463 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 902b7511e86b5e6b006adf138dbe176a/family2 is initiating major compaction (all files) 2023-12-03 10:55:53,463 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:53,463 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:53,464 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 902b7511e86b5e6b006adf138dbe176a/family2 in testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:53,464 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/fdb877844b064d53a9560ca295a0ec6c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/c914de935f4f4415880cb5edd54d000b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/14b9338369a54e208ad16b8e4ba60d40, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/eff429c619014689abc6641d8205547c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/75ad5fa0d0d5443583659236c04bc0bb] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp, totalSize=25.4 K 2023-12-03 10:55:53,464 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting fdb877844b064d53a9560ca295a0ec6c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600944391 2023-12-03 10:55:53,464 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting c914de935f4f4415880cb5edd54d000b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600945464 2023-12-03 10:55:53,465 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 14b9338369a54e208ad16b8e4ba60d40, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600946564 2023-12-03 10:55:53,465 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting eff429c619014689abc6641d8205547c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600948052 2023-12-03 10:55:53,465 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 75ad5fa0d0d5443583659236c04bc0bb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:53,472 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 902b7511e86b5e6b006adf138dbe176a#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:53,479 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023120312f67549ba664d31b491b4688293393a_del 2023-12-03 10:55:53,480 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023120312f67549ba664d31b491b4688293393a_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023120312f67549ba664d31b491b4688293393a_del 2023-12-03 10:55:53,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/381792676c3341cf9be48bb87a506785, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/f83bb3e8c3b3430f86410444d9a7e1d1, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/c93d75b540ec4b7ca168a7de6e350a64, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/9518a4a25064462eb25d31bd0f6eb171, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/7b39762358a74a5985ba1b7acfa76dc3] to archive 2023-12-03 10:55:53,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:53,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/381792676c3341cf9be48bb87a506785 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/381792676c3341cf9be48bb87a506785 2023-12-03 10:55:53,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/f83bb3e8c3b3430f86410444d9a7e1d1 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/f83bb3e8c3b3430f86410444d9a7e1d1 2023-12-03 10:55:53,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/c93d75b540ec4b7ca168a7de6e350a64 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/c93d75b540ec4b7ca168a7de6e350a64 2023-12-03 10:55:53,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/9518a4a25064462eb25d31bd0f6eb171 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/9518a4a25064462eb25d31bd0f6eb171 2023-12-03 10:55:53,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/7b39762358a74a5985ba1b7acfa76dc3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/7b39762358a74a5985ba1b7acfa76dc3 2023-12-03 10:55:54,293 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b89d54023aa4fcaa149d4188e00d6cc 2023-12-03 10:55:54,293 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/.tmp/family2/8b89d54023aa4fcaa149d4188e00d6cc as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/8b89d54023aa4fcaa149d4188e00d6cc 2023-12-03 10:55:54,298 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b89d54023aa4fcaa149d4188e00d6cc 2023-12-03 10:55:54,298 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 902b7511e86b5e6b006adf138dbe176a/family2 of 902b7511e86b5e6b006adf138dbe176a into 8b89d54023aa4fcaa149d4188e00d6cc(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-12-03 10:55:54,299 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:54,299 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:54,299 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 33b2768e307db6deced90abe717d7437/family1 is initiating major compaction (all files) 2023-12-03 10:55:54,299 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:54,299 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:54,299 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 33b2768e307db6deced90abe717d7437/family1 in testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:54,299 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/934a0a248f264fb0bfd847db70454c67, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/11626f328b33496e90ee9e967a053933, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/7e4d330c2a4c491a8a97c77cca31428a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/3a2aec8617924f598cf4d77899d39a30, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/8f9be3d8bba249d584cd96e1dd8d0e00] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp, totalSize=27.1 K 2023-12-03 10:55:54,299 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 934a0a248f264fb0bfd847db70454c67, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600944392 2023-12-03 10:55:54,300 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 11626f328b33496e90ee9e967a053933, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600945464 2023-12-03 10:55:54,300 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 7e4d330c2a4c491a8a97c77cca31428a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600946565 2023-12-03 10:55:54,301 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 3a2aec8617924f598cf4d77899d39a30, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600948052 2023-12-03 10:55:54,301 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 8f9be3d8bba249d584cd96e1dd8d0e00, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:54,310 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 33b2768e307db6deced90abe717d7437#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:54,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/fdb877844b064d53a9560ca295a0ec6c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/c914de935f4f4415880cb5edd54d000b, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/14b9338369a54e208ad16b8e4ba60d40, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/eff429c619014689abc6641d8205547c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/75ad5fa0d0d5443583659236c04bc0bb] to archive 2023-12-03 10:55:54,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:54,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/fdb877844b064d53a9560ca295a0ec6c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/fdb877844b064d53a9560ca295a0ec6c 2023-12-03 10:55:54,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/c914de935f4f4415880cb5edd54d000b to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/c914de935f4f4415880cb5edd54d000b 2023-12-03 10:55:54,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/14b9338369a54e208ad16b8e4ba60d40 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/14b9338369a54e208ad16b8e4ba60d40 2023-12-03 10:55:54,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/eff429c619014689abc6641d8205547c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/eff429c619014689abc6641d8205547c 2023-12-03 10:55:54,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/75ad5fa0d0d5443583659236c04bc0bb to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family2/75ad5fa0d0d5443583659236c04bc0bb 2023-12-03 10:55:54,749 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202312030c26d696746544f99b8b21cfcb6e30a3_del 2023-12-03 10:55:54,749 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202312030c26d696746544f99b8b21cfcb6e30a3_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202312030c26d696746544f99b8b21cfcb6e30a3_del 2023-12-03 10:55:55,601 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61c9945b103a46c48ee921f67a85d5d2 2023-12-03 10:55:55,601 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family1/61c9945b103a46c48ee921f67a85d5d2 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/61c9945b103a46c48ee921f67a85d5d2 2023-12-03 10:55:55,624 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61c9945b103a46c48ee921f67a85d5d2 2023-12-03 10:55:55,625 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 33b2768e307db6deced90abe717d7437/family1 of 33b2768e307db6deced90abe717d7437 into 61c9945b103a46c48ee921f67a85d5d2(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:55,625 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:55,625 DEBUG [Listener at localhost/33475] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-12-03 10:55:55,625 DEBUG [Listener at localhost/33475] regionserver.HStore(1912): 33b2768e307db6deced90abe717d7437/family2 is initiating major compaction (all files) 2023-12-03 10:55:55,625 INFO [Listener at localhost/33475] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-03 10:55:55,625 INFO [Listener at localhost/33475] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-03 10:55:55,625 INFO [Listener at localhost/33475] regionserver.HRegion(2259): Starting compaction of 33b2768e307db6deced90abe717d7437/family2 in testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:55,625 INFO [Listener at localhost/33475] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/774955c3c45949fca9a90ee488e93987, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/f0a2c1b7fc544a1b88407ddc54c95748, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/4b6920cbe8cc4d109b59045c204b527c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/3148a9c20da148a19a9f54ba28589ce3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/120aa9b8dd9b4b2b9374b1cd02283f8c] into tmpdir=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp, totalSize=25.4 K 2023-12-03 10:55:55,626 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 774955c3c45949fca9a90ee488e93987, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701600944392 2023-12-03 10:55:55,626 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting f0a2c1b7fc544a1b88407ddc54c95748, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701600945464 2023-12-03 10:55:55,626 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 4b6920cbe8cc4d109b59045c204b527c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701600946565 2023-12-03 10:55:55,627 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 3148a9c20da148a19a9f54ba28589ce3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701600948052 2023-12-03 10:55:55,627 DEBUG [Listener at localhost/33475] compactions.Compactor(207): Compacting 120aa9b8dd9b4b2b9374b1cd02283f8c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-12-03 10:55:55,634 INFO [Listener at localhost/33475] throttle.PressureAwareThroughputController(145): 33b2768e307db6deced90abe717d7437#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-12-03 10:55:55,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/934a0a248f264fb0bfd847db70454c67, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/11626f328b33496e90ee9e967a053933, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/7e4d330c2a4c491a8a97c77cca31428a, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/3a2aec8617924f598cf4d77899d39a30, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/8f9be3d8bba249d584cd96e1dd8d0e00] to archive 2023-12-03 10:55:55,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:55,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/934a0a248f264fb0bfd847db70454c67 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/934a0a248f264fb0bfd847db70454c67 2023-12-03 10:55:55,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/11626f328b33496e90ee9e967a053933 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/11626f328b33496e90ee9e967a053933 2023-12-03 10:55:55,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/7e4d330c2a4c491a8a97c77cca31428a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/7e4d330c2a4c491a8a97c77cca31428a 2023-12-03 10:55:55,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/3a2aec8617924f598cf4d77899d39a30 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/3a2aec8617924f598cf4d77899d39a30 2023-12-03 10:55:55,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/8f9be3d8bba249d584cd96e1dd8d0e00 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/8f9be3d8bba249d584cd96e1dd8d0e00 2023-12-03 10:55:56,041 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231203891801fa41f64733b21c0dbd7f7c3b85_del 2023-12-03 10:55:56,041 INFO [Listener at localhost/33475] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203891801fa41f64733b21c0dbd7f7c3b85_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231203891801fa41f64733b21c0dbd7f7c3b85_del 2023-12-03 10:55:56,856 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7418f09da6f74f6eb8655ea71b18da33 2023-12-03 10:55:56,856 DEBUG [Listener at localhost/33475] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/.tmp/family2/7418f09da6f74f6eb8655ea71b18da33 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/7418f09da6f74f6eb8655ea71b18da33 2023-12-03 10:55:56,860 INFO [Listener at localhost/33475] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7418f09da6f74f6eb8655ea71b18da33 2023-12-03 10:55:56,861 INFO [Listener at localhost/33475] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 33b2768e307db6deced90abe717d7437/family2 of 33b2768e307db6deced90abe717d7437 into 7418f09da6f74f6eb8655ea71b18da33(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-12-03 10:55:56,861 DEBUG [Listener at localhost/33475] regionserver.HRegion(2289): Compaction status journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:56,865 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:56,868 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:56,871 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:56,872 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:56,877 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46307] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xC8M\x86?\xAE\xB4\xF49\x16=\xDCL\xBB\xC0k"\x10o\xE4RN\x8E9M+\x1C\xCB\xD5\x9B@\x1Fl\x13*\x10?\xA2\xF4(/\xF2\x8A\xB2\xCE\x95i'\xBCi\x9D\xA32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-12-03 10:55:56,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] procedure2.ProcedureExecutor(1075): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-12-03 10:55:56,900 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-12-03 10:55:56,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:55:56,900 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701601556900 2023-12-03 10:55:56,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-12-03 10:55:56,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/774955c3c45949fca9a90ee488e93987, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/f0a2c1b7fc544a1b88407ddc54c95748, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/4b6920cbe8cc4d109b59045c204b527c, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/3148a9c20da148a19a9f54ba28589ce3, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/120aa9b8dd9b4b2b9374b1cd02283f8c] to archive 2023-12-03 10:55:56,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:56,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/774955c3c45949fca9a90ee488e93987 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/774955c3c45949fca9a90ee488e93987 2023-12-03 10:55:56,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/f0a2c1b7fc544a1b88407ddc54c95748 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/f0a2c1b7fc544a1b88407ddc54c95748 2023-12-03 10:55:56,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/4b6920cbe8cc4d109b59045c204b527c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/4b6920cbe8cc4d109b59045c204b527c 2023-12-03 10:55:56,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/3148a9c20da148a19a9f54ba28589ce3 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/3148a9c20da148a19a9f54ba28589ce3 2023-12-03 10:55:56,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/120aa9b8dd9b4b2b9374b1cd02283f8c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family2/120aa9b8dd9b4b2b9374b1cd02283f8c 2023-12-03 10:55:57,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-12-03 10:55:57,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202312032e3944e85e894fdfa16e78c7081109b1_del 2023-12-03 10:55:57,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231203282b94c54e2f49e5a83e33a3dc1d3909_del 2023-12-03 10:55:57,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202312030c26d696746544f99b8b21cfcb6e30a3_del 2023-12-03 10:55:57,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-12-03 10:55:57,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] zookeeper.ReadOnlyZKClient(139): Connect 0x72654dfd to 127.0.0.1:62442 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-03 10:55:57,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@eb06928, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-03 10:55:57,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231203 for table='testMajorCompactionFromAdmin' and column='family1' 2023-12-03 10:55:57,455 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023120355dac5ef8618423b87f0826961651bd5 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023120355dac5ef8618423b87f0826961651bd5 2023-12-03 10:55:57,456 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231203 table='testMajorCompactionFromAdmin' column='family1' 2023-12-03 10:55:57,466 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-03 10:55:57,469 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-03 10:55:57,475 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-03 10:55:57,477 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-03 10:55:57,510 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231203/family1/1b472266808248729cf1efda856bb43e first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-12-03 10:55:57,510 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231203/family1/1b472266808248729cf1efda856bb43e}] 2023-12-03 10:55:57,515 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231203/family1/1b472266808248729cf1efda856bb43e for inclusion in 82b46d94df9a48f2faf6286e289a22cf/family1 2023-12-03 10:55:57,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-12-03 10:55:57,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(777): Region bounds: first=1 last=2 2023-12-03 10:55:57,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:57,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231203/family1/1b472266808248729cf1efda856bb43e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__i9vnob0v61rgq07p51ajmmg871ofiks5i4b9a7sg1c7a4ba2h1p1k2jrs139dbqn/family1/1b472266808248729cf1efda856bb43e 2023-12-03 10:55:57,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__i9vnob0v61rgq07p51ajmmg871ofiks5i4b9a7sg1c7a4ba2h1p1k2jrs139dbqn/family1/1b472266808248729cf1efda856bb43e as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/e4b1e3a3d2e049e9997e8c0a827b5d2b_SeqId_28_ 2023-12-03 10:55:57,540 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__i9vnob0v61rgq07p51ajmmg871ofiks5i4b9a7sg1c7a4ba2h1p1k2jrs139dbqn/family1/1b472266808248729cf1efda856bb43e into 82b46d94df9a48f2faf6286e289a22cf/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/e4b1e3a3d2e049e9997e8c0a827b5d2b_SeqId_28_ - updating store file list. 2023-12-03 10:55:57,561 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/e4b1e3a3d2e049e9997e8c0a827b5d2b_SeqId_28_ into 82b46d94df9a48f2faf6286e289a22cf/family1 2023-12-03 10:55:57,561 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__i9vnob0v61rgq07p51ajmmg871ofiks5i4b9a7sg1c7a4ba2h1p1k2jrs139dbqn/family1/1b472266808248729cf1efda856bb43e into 82b46d94df9a48f2faf6286e289a22cf/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/family1/e4b1e3a3d2e049e9997e8c0a827b5d2b_SeqId_28_) 2023-12-03 10:55:57,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__i9vnob0v61rgq07p51ajmmg871ofiks5i4b9a7sg1c7a4ba2h1p1k2jrs139dbqn/family1/1b472266808248729cf1efda856bb43e 2023-12-03 10:55:57,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231203 table='testMajorCompactionFromAdmin' column='family1' 2023-12-03 10:55:57,564 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:57,565 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202312036bf02d6bd99343ad809eaae4a4c0b834 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202312036bf02d6bd99343ad809eaae4a4c0b834 2023-12-03 10:55:57,566 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202312039a28a0347afb48e79c7e8e888a323366 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202312039a28a0347afb48e79c7e8e888a323366 2023-12-03 10:55:57,567 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202312039c1226c6bde2403ba38f87e7984762a9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202312039c1226c6bde2403ba38f87e7984762a9 2023-12-03 10:55:57,568 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231203c662531e8bfb4165a5ba17b0603c677e to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231203c662531e8bfb4165a5ba17b0603c677e 2023-12-03 10:55:57,568 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-12-03 10:55:57,568 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231203' 2023-12-03 10:55:57,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231203 for table='testMajorCompactionFromAdmin' and column='family1' 2023-12-03 10:55:57,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231203 for table='testMajorCompactionFromAdmin' and column='family1' 2023-12-03 10:55:58,109 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231203cbbfe51782fe4bdc9a125c1d661dc83d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231203cbbfe51782fe4bdc9a125c1d661dc83d 2023-12-03 10:55:58,110 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231203 table='testMajorCompactionFromAdmin' column='family1' 2023-12-03 10:55:58,149 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231203/family1/c25cbdcad6a04ecc9428a1415967004c first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-12-03 10:55:58,150 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231203/family1/c25cbdcad6a04ecc9428a1415967004c}] 2023-12-03 10:55:58,151 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231203/family1/c25cbdcad6a04ecc9428a1415967004c for inclusion in 33b2768e307db6deced90abe717d7437/family1 2023-12-03 10:55:58,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-12-03 10:55:58,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(777): Region bounds: first=2 last= 2023-12-03 10:55:58,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:58,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231203/family1/c25cbdcad6a04ecc9428a1415967004c to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__tkusuusvtcseiphrnujdl48ba8qs64c60vqcv1hnk6kfivden8dq6k4999p6tejc/family1/c25cbdcad6a04ecc9428a1415967004c 2023-12-03 10:55:58,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__tkusuusvtcseiphrnujdl48ba8qs64c60vqcv1hnk6kfivden8dq6k4999p6tejc/family1/c25cbdcad6a04ecc9428a1415967004c as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/7e9b7842e64c4badb5fa4719c226b4c9_SeqId_28_ 2023-12-03 10:55:58,176 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__tkusuusvtcseiphrnujdl48ba8qs64c60vqcv1hnk6kfivden8dq6k4999p6tejc/family1/c25cbdcad6a04ecc9428a1415967004c into 33b2768e307db6deced90abe717d7437/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/7e9b7842e64c4badb5fa4719c226b4c9_SeqId_28_ - updating store file list. 2023-12-03 10:55:58,197 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/7e9b7842e64c4badb5fa4719c226b4c9_SeqId_28_ into 33b2768e307db6deced90abe717d7437/family1 2023-12-03 10:55:58,197 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__tkusuusvtcseiphrnujdl48ba8qs64c60vqcv1hnk6kfivden8dq6k4999p6tejc/family1/c25cbdcad6a04ecc9428a1415967004c into 33b2768e307db6deced90abe717d7437/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/family1/7e9b7842e64c4badb5fa4719c226b4c9_SeqId_28_) 2023-12-03 10:55:58,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__tkusuusvtcseiphrnujdl48ba8qs64c60vqcv1hnk6kfivden8dq6k4999p6tejc/family1/c25cbdcad6a04ecc9428a1415967004c 2023-12-03 10:55:58,199 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231203 table='testMajorCompactionFromAdmin' column='family1' 2023-12-03 10:55:58,199 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:58,201 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202312037f41c5516e3c40be8a2ad25dffab0356 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202312037f41c5516e3c40be8a2ad25dffab0356 2023-12-03 10:55:58,202 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202312038fed0210237847358ff0e0877a95b722 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202312038fed0210237847358ff0e0877a95b722 2023-12-03 10:55:58,203 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231203c5b399e65c14405aa8dd23b7477a5884 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231203c5b399e65c14405aa8dd23b7477a5884 2023-12-03 10:55:58,203 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231203ee7b39c191d94e838273ed3133a14d80 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231203ee7b39c191d94e838273ed3133a14d80 2023-12-03 10:55:58,204 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-12-03 10:55:58,204 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231203' 2023-12-03 10:55:58,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231203 for table='testMajorCompactionFromAdmin' and column='family1' 2023-12-03 10:55:58,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231203 for table='testMajorCompactionFromAdmin' and column='family1' 2023-12-03 10:55:59,148 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023120370bb37775a3346a6b8d95a2e184b978d to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023120370bb37775a3346a6b8d95a2e184b978d 2023-12-03 10:55:59,149 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231203 table='testMajorCompactionFromAdmin' column='family1' 2023-12-03 10:55:59,189 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231203/family1/2ef117bc6d2547c7a0875f4a0c1db2ef first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-12-03 10:55:59,190 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a., hostname=jenkins-hbase4.apache.org,44259,1701600798821, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231203/family1/2ef117bc6d2547c7a0875f4a0c1db2ef}] 2023-12-03 10:55:59,192 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(763): Validating hfile at hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231203/family1/2ef117bc6d2547c7a0875f4a0c1db2ef for inclusion in 902b7511e86b5e6b006adf138dbe176a/family1 2023-12-03 10:55:59,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-12-03 10:55:59,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(777): Region bounds: first= last=1 2023-12-03 10:55:59,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegion(2446): Flush status journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:59,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231203/family1/2ef117bc6d2547c7a0875f4a0c1db2ef to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__26s44p6rj9tbqsm2nin6gke0md1ocvo96lbk1tf0m1spacntpln1qd0e6oldraf8/family1/2ef117bc6d2547c7a0875f4a0c1db2ef 2023-12-03 10:55:59,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__26s44p6rj9tbqsm2nin6gke0md1ocvo96lbk1tf0m1spacntpln1qd0e6oldraf8/family1/2ef117bc6d2547c7a0875f4a0c1db2ef as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/d7289df5743d4756851570d04834c695_SeqId_28_ 2023-12-03 10:55:59,215 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(849): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__26s44p6rj9tbqsm2nin6gke0md1ocvo96lbk1tf0m1spacntpln1qd0e6oldraf8/family1/2ef117bc6d2547c7a0875f4a0c1db2ef into 902b7511e86b5e6b006adf138dbe176a/family1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/d7289df5743d4756851570d04834c695_SeqId_28_ - updating store file list. 2023-12-03 10:55:59,237 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(882): Loaded HFile hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/d7289df5743d4756851570d04834c695_SeqId_28_ into 902b7511e86b5e6b006adf138dbe176a/family1 2023-12-03 10:55:59,237 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.HStore(855): Successfully loaded hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__26s44p6rj9tbqsm2nin6gke0md1ocvo96lbk1tf0m1spacntpln1qd0e6oldraf8/family1/2ef117bc6d2547c7a0875f4a0c1db2ef into 902b7511e86b5e6b006adf138dbe176a/family1 (new location: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/family1/d7289df5743d4756851570d04834c695_SeqId_28_) 2023-12-03 10:55:59,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44259] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/staging/jenkins__testMajorCompactionFromAdmin__26s44p6rj9tbqsm2nin6gke0md1ocvo96lbk1tf0m1spacntpln1qd0e6oldraf8/family1/2ef117bc6d2547c7a0875f4a0c1db2ef 2023-12-03 10:55:59,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231203 table='testMajorCompactionFromAdmin' column='family1' 2023-12-03 10:55:59,239 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:59,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023120355cbf023be2149e2af7bba2d3d102a9f to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023120355cbf023be2149e2af7bba2d3d102a9f 2023-12-03 10:55:59,241 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202312036112e60b7b6040af8b961bae96283e4a to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202312036112e60b7b6040af8b961bae96283e4a 2023-12-03 10:55:59,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231203a6a9279baf994f1e8849995e7e4e21b9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231203a6a9279baf994f1e8849995e7e4e21b9 2023-12-03 10:55:59,243 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231203eddcf1ca8d9c4425b1e1014d710fdce9 to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231203eddcf1ca8d9c4425b1e1014d710fdce9 2023-12-03 10:55:59,243 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-12-03 10:55:59,243 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231203' 2023-12-03 10:55:59,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231203 for table='testMajorCompactionFromAdmin' and column='family1' 2023-12-03 10:55:59,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-12-03 10:55:59,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-12-03 10:55:59,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202312032e3944e85e894fdfa16e78c7081109b1_del] 2023-12-03 10:55:59,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:59,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202312032e3944e85e894fdfa16e78c7081109b1_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202312032e3944e85e894fdfa16e78c7081109b1_del 2023-12-03 10:55:59,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-12-03 10:55:59,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231203282b94c54e2f49e5a83e33a3dc1d3909_del] 2023-12-03 10:55:59,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:59,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231203282b94c54e2f49e5a83e33a3dc1d3909_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231203282b94c54e2f49e5a83e33a3dc1d3909_del 2023-12-03 10:55:59,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-12-03 10:55:59,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202312030c26d696746544f99b8b21cfcb6e30a3_del] 2023-12-03 10:55:59,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] backup.HFileArchiver(360): Archiving compacted files. 2023-12-03 10:55:59,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202312030c26d696746544f99b8b21cfcb6e30a3_del to hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202312030c26d696746544f99b8b21cfcb6e30a3_del 2023-12-03 10:55:59,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-12-03 10:55:59,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701600803127] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-12-03 10:55:59,249 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-12-03 10:55:59,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.3510 sec 2023-12-03 10:55:59,267 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:59,269 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:59,271 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-12-03 10:55:59,272 DEBUG [Listener at localhost/33475] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-12-03 10:55:59,276 INFO [Listener at localhost/33475] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-03 10:55:59,317 INFO [Listener at localhost/33475] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=252 (was 260), OpenFileDescriptor=675 (was 670) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=145 (was 149), ProcessCount=169 (was 171), AvailableMemoryMB=2849 (was 3376) 2023-12-03 10:55:59,317 DEBUG [Listener at localhost/33475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7faa020d to 127.0.0.1:62442 2023-12-03 10:55:59,318 DEBUG [Listener at localhost/33475] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:55:59,318 INFO [Listener at localhost/33475] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-12-03 10:55:59,318 INFO [Listener at localhost/33475] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-03 10:55:59,318 DEBUG [Listener at localhost/33475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b2a962e to 127.0.0.1:62442 2023-12-03 10:55:59,319 DEBUG [Listener at localhost/33475] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:55:59,319 DEBUG [Listener at localhost/33475] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-12-03 10:55:59,319 DEBUG [Listener at localhost/33475] util.JVMClusterUtil(257): Found active master hash=1028977984, stopped=false 2023-12-03 10:55:59,319 INFO [Listener at localhost/33475] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46307,1701600797605 2023-12-03 10:55:59,321 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-12-03 10:55:59,321 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-12-03 10:55:59,321 INFO [Listener at localhost/33475] procedure2.ProcedureExecutor(675): Stopping 2023-12-03 10:55:59,321 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-03 10:55:59,322 DEBUG [Listener at localhost/33475] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a813ef7 to 127.0.0.1:62442 2023-12-03 10:55:59,322 DEBUG [Listener at localhost/33475] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:55:59,322 INFO [Listener at localhost/33475] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,44259,1701600798821' ***** 2023-12-03 10:55:59,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-12-03 10:55:59,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-12-03 10:55:59,322 INFO [Listener at localhost/33475] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2023-12-03 10:55:59,322 INFO [RS:0;jenkins-hbase4:44259] regionserver.HeapMemoryManager(220): Stopping 2023-12-03 10:55:59,322 INFO [RS:0;jenkins-hbase4:44259] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-12-03 10:55:59,322 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 82b46d94df9a48f2faf6286e289a22cf 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 6569c89c13b80b87af2e4ef76aca532c 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 902b7511e86b5e6b006adf138dbe176a 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 33b2768e307db6deced90abe717d7437 2023-12-03 10:55:59,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 82b46d94df9a48f2faf6286e289a22cf, disabling compactions & flushes 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 49a8cf4e23954387a072460722ce1bed 2023-12-03 10:55:59,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for c385de4f6e36b035b666ba4cdfb178ce 2023-12-03 10:55:59,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 94e4474ff1bcc350b17fcf6b47380e5d 2023-12-03 10:55:59,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. after waiting 0 ms 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 236c5a2347aa1bfce918e0fb3cc51579 2023-12-03 10:55:59,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 68d8dbb8a8d74773b96cfe331b55f348 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 2e27303c5798e37a241debf9d11c54c6 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for ce9122c7de6f34aabd8844002ba75fb5 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 6f6f0dabc1a4ce1265e8b9909953c142 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 8b5495b1604bfe1ccf77f0ddde66fab7 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 8289e8e52c6c796e8f6a76e95ee71cf9 2023-12-03 10:55:59,323 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 4132a9cb8c9f3da44edb46b737bab3eb 2023-12-03 10:55:59,324 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 6a2227d5c782c10299a2b96f43c845b4 2023-12-03 10:55:59,324 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:55:59,324 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 301f476df2adc9532f12cced548b13e8 2023-12-03 10:55:59,324 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for c7b4c05e53c817658d496c4380ef7b0f 2023-12-03 10:55:59,324 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 165139cb0d2367959816aa2994261e13 2023-12-03 10:55:59,324 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:55:59,324 DEBUG [RS:0;jenkins-hbase4:44259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61fb2abe to 127.0.0.1:62442 2023-12-03 10:55:59,324 DEBUG [RS:0;jenkins-hbase4:44259] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:55:59,324 INFO [RS:0;jenkins-hbase4:44259] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-12-03 10:55:59,324 INFO [RS:0;jenkins-hbase4:44259] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-12-03 10:55:59,324 INFO [RS:0;jenkins-hbase4:44259] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-12-03 10:55:59,324 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2023-12-03 10:55:59,325 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1477): Waiting on 21 regions to close 2023-12-03 10:55:59,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-12-03 10:55:59,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-12-03 10:55:59,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-12-03 10:55:59,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-12-03 10:55:59,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-12-03 10:55:59,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-12-03 10:55:59,325 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1507): Waiting on 1588230740, 165139cb0d2367959816aa2994261e13, 236c5a2347aa1bfce918e0fb3cc51579, 2e27303c5798e37a241debf9d11c54c6, 301f476df2adc9532f12cced548b13e8, 33b2768e307db6deced90abe717d7437, 4132a9cb8c9f3da44edb46b737bab3eb, 49a8cf4e23954387a072460722ce1bed, 6569c89c13b80b87af2e4ef76aca532c, 68d8dbb8a8d74773b96cfe331b55f348, 6a2227d5c782c10299a2b96f43c845b4, 6f6f0dabc1a4ce1265e8b9909953c142, 8289e8e52c6c796e8f6a76e95ee71cf9, 82b46d94df9a48f2faf6286e289a22cf, 8b5495b1604bfe1ccf77f0ddde66fab7, 902b7511e86b5e6b006adf138dbe176a, 94e4474ff1bcc350b17fcf6b47380e5d, c385de4f6e36b035b666ba4cdfb178ce, c7b4c05e53c817658d496c4380ef7b0f, ce9122c7de6f34aabd8844002ba75fb5, eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:55:59,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/82b46d94df9a48f2faf6286e289a22cf/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-12-03 10:55:59,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:59,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 82b46d94df9a48f2faf6286e289a22cf: 2023-12-03 10:55:59,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1701600942203.82b46d94df9a48f2faf6286e289a22cf. 2023-12-03 10:55:59,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6569c89c13b80b87af2e4ef76aca532c, disabling compactions & flushes 2023-12-03 10:55:59,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:55:59,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:55:59,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. after waiting 0 ms 2023-12-03 10:55:59,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:55:59,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyPolicy/6569c89c13b80b87af2e4ef76aca532c/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-12-03 10:55:59,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:55:59,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6569c89c13b80b87af2e4ef76aca532c: 2023-12-03 10:55:59,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1701600842443.6569c89c13b80b87af2e4ef76aca532c. 2023-12-03 10:55:59,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 902b7511e86b5e6b006adf138dbe176a, disabling compactions & flushes 2023-12-03 10:55:59,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:59,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:59,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. after waiting 0 ms 2023-12-03 10:55:59,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:59,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/902b7511e86b5e6b006adf138dbe176a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-12-03 10:55:59,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:59,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 902b7511e86b5e6b006adf138dbe176a: 2023-12-03 10:55:59,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1701600942203.902b7511e86b5e6b006adf138dbe176a. 2023-12-03 10:55:59,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 33b2768e307db6deced90abe717d7437, disabling compactions & flushes 2023-12-03 10:55:59,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:59,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:59,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. after waiting 0 ms 2023-12-03 10:55:59,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:59,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionFromAdmin/33b2768e307db6deced90abe717d7437/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-12-03 10:55:59,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:59,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 33b2768e307db6deced90abe717d7437: 2023-12-03 10:55:59,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1701600942203.33b2768e307db6deced90abe717d7437. 2023-12-03 10:55:59,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 49a8cf4e23954387a072460722ce1bed, disabling compactions & flushes 2023-12-03 10:55:59,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:55:59,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:55:59,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. after waiting 0 ms 2023-12-03 10:55:59,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:55:59,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/49a8cf4e23954387a072460722ce1bed/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-12-03 10:55:59,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:55:59,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 49a8cf4e23954387a072460722ce1bed: 2023-12-03 10:55:59,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1701600837814.49a8cf4e23954387a072460722ce1bed. 2023-12-03 10:55:59,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c385de4f6e36b035b666ba4cdfb178ce, disabling compactions & flushes 2023-12-03 10:55:59,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:59,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:59,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. after waiting 0 ms 2023-12-03 10:55:59,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:59,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithMonthlyPolicy/c385de4f6e36b035b666ba4cdfb178ce/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-12-03 10:55:59,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:59,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c385de4f6e36b035b666ba4cdfb178ce: 2023-12-03 10:55:59,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1701600930252.c385de4f6e36b035b666ba4cdfb178ce. 2023-12-03 10:55:59,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 94e4474ff1bcc350b17fcf6b47380e5d, disabling compactions & flushes 2023-12-03 10:55:59,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:55:59,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:55:59,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. after waiting 0 ms 2023-12-03 10:55:59,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:55:59,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/94e4474ff1bcc350b17fcf6b47380e5d/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-12-03 10:55:59,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:55:59,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 94e4474ff1bcc350b17fcf6b47380e5d: 2023-12-03 10:55:59,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1701600837814.94e4474ff1bcc350b17fcf6b47380e5d. 2023-12-03 10:55:59,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 236c5a2347aa1bfce918e0fb3cc51579, disabling compactions & flushes 2023-12-03 10:55:59,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:59,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:59,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. after waiting 0 ms 2023-12-03 10:55:59,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:59,351 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-12-03 10:55:59,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/236c5a2347aa1bfce918e0fb3cc51579/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-12-03 10:55:59,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:59,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 236c5a2347aa1bfce918e0fb3cc51579: 2023-12-03 10:55:59,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1701600914249.236c5a2347aa1bfce918e0fb3cc51579. 2023-12-03 10:55:59,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 68d8dbb8a8d74773b96cfe331b55f348, disabling compactions & flushes 2023-12-03 10:55:59,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:55:59,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:55:59,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. after waiting 0 ms 2023-12-03 10:55:59,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:55:59,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/68d8dbb8a8d74773b96cfe331b55f348/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-12-03 10:55:59,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:55:59,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 68d8dbb8a8d74773b96cfe331b55f348: 2023-12-03 10:55:59,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701600803288.68d8dbb8a8d74773b96cfe331b55f348. 2023-12-03 10:55:59,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2e27303c5798e37a241debf9d11c54c6, disabling compactions & flushes 2023-12-03 10:55:59,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:55:59,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:55:59,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. after waiting 0 ms 2023-12-03 10:55:59,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:55:59,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2e27303c5798e37a241debf9d11c54c6/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-12-03 10:55:59,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:55:59,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2e27303c5798e37a241debf9d11c54c6: 2023-12-03 10:55:59,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701600869946.2e27303c5798e37a241debf9d11c54c6. 2023-12-03 10:55:59,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce9122c7de6f34aabd8844002ba75fb5, disabling compactions & flushes 2023-12-03 10:55:59,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:55:59,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:55:59,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. after waiting 0 ms 2023-12-03 10:55:59,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:55:59,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithMonthlyPolicy/ce9122c7de6f34aabd8844002ba75fb5/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-12-03 10:55:59,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:55:59,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce9122c7de6f34aabd8844002ba75fb5: 2023-12-03 10:55:59,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1701600815990.ce9122c7de6f34aabd8844002ba75fb5. 2023-12-03 10:55:59,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f6f0dabc1a4ce1265e8b9909953c142, disabling compactions & flushes 2023-12-03 10:55:59,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:55:59,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:55:59,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. after waiting 0 ms 2023-12-03 10:55:59,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:55:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testScannerOnBulkLoadRefHFiles/6f6f0dabc1a4ce1265e8b9909953c142/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-12-03 10:55:59,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:55:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f6f0dabc1a4ce1265e8b9909953c142: 2023-12-03 10:55:59,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1701600837814.6f6f0dabc1a4ce1265e8b9909953c142. 2023-12-03 10:55:59,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8b5495b1604bfe1ccf77f0ddde66fab7, disabling compactions & flushes 2023-12-03 10:55:59,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:59,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:59,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. after waiting 0 ms 2023-12-03 10:55:59,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:59,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/8b5495b1604bfe1ccf77f0ddde66fab7/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-12-03 10:55:59,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:59,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8b5495b1604bfe1ccf77f0ddde66fab7: 2023-12-03 10:55:59,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1701600890079.8b5495b1604bfe1ccf77f0ddde66fab7. 2023-12-03 10:55:59,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8289e8e52c6c796e8f6a76e95ee71cf9, disabling compactions & flushes 2023-12-03 10:55:59,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:59,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:59,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. after waiting 0 ms 2023-12-03 10:55:59,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/8289e8e52c6c796e8f6a76e95ee71cf9/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-12-03 10:55:59,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8289e8e52c6c796e8f6a76e95ee71cf9: 2023-12-03 10:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1701600914249.8289e8e52c6c796e8f6a76e95ee71cf9. 2023-12-03 10:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4132a9cb8c9f3da44edb46b737bab3eb, disabling compactions & flushes 2023-12-03 10:55:59,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. after waiting 0 ms 2023-12-03 10:55:59,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:59,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/4132a9cb8c9f3da44edb46b737bab3eb/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-12-03 10:55:59,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:59,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4132a9cb8c9f3da44edb46b737bab3eb: 2023-12-03 10:55:59,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1701600890079.4132a9cb8c9f3da44edb46b737bab3eb. 2023-12-03 10:55:59,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6a2227d5c782c10299a2b96f43c845b4, disabling compactions & flushes 2023-12-03 10:55:59,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:59,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:59,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. after waiting 0 ms 2023-12-03 10:55:59,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:59,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/ns/testMinorCompaction/6a2227d5c782c10299a2b96f43c845b4/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-12-03 10:55:59,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:59,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6a2227d5c782c10299a2b96f43c845b4: 2023-12-03 10:55:59,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1701600914249.6a2227d5c782c10299a2b96f43c845b4. 2023-12-03 10:55:59,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eb5a693c652f5b30580c302a0d3e7b3d, disabling compactions & flushes 2023-12-03 10:55:59,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:55:59,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:55:59,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. after waiting 0 ms 2023-12-03 10:55:59,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:55:59,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing eb5a693c652f5b30580c302a0d3e7b3d 1/1 column families, dataSize=109 B heapSize=592 B 2023-12-03 10:55:59,410 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-12-03 10:55:59,526 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1507): Waiting on 1588230740, 165139cb0d2367959816aa2994261e13, 301f476df2adc9532f12cced548b13e8, c7b4c05e53c817658d496c4380ef7b0f, eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:55:59,726 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1507): Waiting on 1588230740, 165139cb0d2367959816aa2994261e13, 301f476df2adc9532f12cced548b13e8, c7b4c05e53c817658d496c4380ef7b0f, eb5a693c652f5b30580c302a0d3e7b3d 2023-12-03 10:55:59,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/.tmp/info/48044b633c7d427bb399ea15c8771503 2023-12-03 10:55:59,739 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48044b633c7d427bb399ea15c8771503 2023-12-03 10:55:59,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d/.tmp/info/cdf113a7ac4242c8910443615013f786 2023-12-03 10:55:59,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d/.tmp/info/cdf113a7ac4242c8910443615013f786 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d/info/cdf113a7ac4242c8910443615013f786 2023-12-03 10:55:59,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d/info/cdf113a7ac4242c8910443615013f786, entries=3, sequenceid=7, filesize=4.8 K 2023-12-03 10:55:59,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for eb5a693c652f5b30580c302a0d3e7b3d in 416ms, sequenceid=7, compaction requested=false 2023-12-03 10:55:59,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/namespace/eb5a693c652f5b30580c302a0d3e7b3d/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-12-03 10:55:59,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:55:59,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eb5a693c652f5b30580c302a0d3e7b3d: 2023-12-03 10:55:59,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1701600801592.eb5a693c652f5b30580c302a0d3e7b3d. 2023-12-03 10:55:59,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 301f476df2adc9532f12cced548b13e8, disabling compactions & flushes 2023-12-03 10:55:59,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:55:59,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:55:59,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. after waiting 0 ms 2023-12-03 10:55:59,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:55:59,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/301f476df2adc9532f12cced548b13e8/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-12-03 10:55:59,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:55:59,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 301f476df2adc9532f12cced548b13e8: 2023-12-03 10:55:59,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701600854572.301f476df2adc9532f12cced548b13e8. 2023-12-03 10:55:59,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c7b4c05e53c817658d496c4380ef7b0f, disabling compactions & flushes 2023-12-03 10:55:59,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:55:59,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:55:59,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. after waiting 0 ms 2023-12-03 10:55:59,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:55:59,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testMinorCompactionWithWeeklyPolicy/c7b4c05e53c817658d496c4380ef7b0f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-12-03 10:55:59,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:55:59,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c7b4c05e53c817658d496c4380ef7b0f: 2023-12-03 10:55:59,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1701600826637.c7b4c05e53c817658d496c4380ef7b0f. 2023-12-03 10:55:59,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 165139cb0d2367959816aa2994261e13, disabling compactions & flushes 2023-12-03 10:55:59,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:59,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:59,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. after waiting 0 ms 2023-12-03 10:55:59,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:59,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/default/testCompactionWithHFileLink/165139cb0d2367959816aa2994261e13/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-12-03 10:55:59,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:59,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 165139cb0d2367959816aa2994261e13: 2023-12-03 10:55:59,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1701600890079.165139cb0d2367959816aa2994261e13. 2023-12-03 10:55:59,926 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-12-03 10:56:00,126 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-12-03 10:56:00,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/.tmp/rep_barrier/93c8c16444be434699a8549a99120dc3 2023-12-03 10:56:00,148 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93c8c16444be434699a8549a99120dc3 2023-12-03 10:56:00,289 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-12-03 10:56:00,289 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-12-03 10:56:00,327 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2023-12-03 10:56:00,327 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-12-03 10:56:00,327 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-12-03 10:56:00,527 DEBUG [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-12-03 10:56:00,555 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/.tmp/table/35983aa591014d628e2696dc690267f1 2023-12-03 10:56:00,558 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35983aa591014d628e2696dc690267f1 2023-12-03 10:56:00,558 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/.tmp/info/48044b633c7d427bb399ea15c8771503 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/info/48044b633c7d427bb399ea15c8771503 2023-12-03 10:56:00,562 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48044b633c7d427bb399ea15c8771503 2023-12-03 10:56:00,562 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/info/48044b633c7d427bb399ea15c8771503, entries=226, sequenceid=130, filesize=37.9 K 2023-12-03 10:56:00,562 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/.tmp/rep_barrier/93c8c16444be434699a8549a99120dc3 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/rep_barrier/93c8c16444be434699a8549a99120dc3 2023-12-03 10:56:00,566 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93c8c16444be434699a8549a99120dc3 2023-12-03 10:56:00,566 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/rep_barrier/93c8c16444be434699a8549a99120dc3, entries=1, sequenceid=130, filesize=5.0 K 2023-12-03 10:56:00,566 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/.tmp/table/35983aa591014d628e2696dc690267f1 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/table/35983aa591014d628e2696dc690267f1 2023-12-03 10:56:00,569 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35983aa591014d628e2696dc690267f1 2023-12-03 10:56:00,569 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/table/35983aa591014d628e2696dc690267f1, entries=27, sequenceid=130, filesize=6.6 K 2023-12-03 10:56:00,571 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1246ms, sequenceid=130, compaction requested=false 2023-12-03 10:56:00,574 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-12-03 10:56:00,575 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-12-03 10:56:00,575 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-12-03 10:56:00,575 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-12-03 10:56:00,575 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-12-03 10:56:00,727 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,44259,1701600798821; all regions closed. 2023-12-03 10:56:00,734 DEBUG [RS:0;jenkins-hbase4:44259] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/oldWALs 2023-12-03 10:56:00,735 INFO [RS:0;jenkins-hbase4:44259] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44259%2C1701600798821.meta:.meta(num 1701600801310) 2023-12-03 10:56:00,738 DEBUG [RS:0;jenkins-hbase4:44259] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/oldWALs 2023-12-03 10:56:00,738 INFO [RS:0;jenkins-hbase4:44259] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44259%2C1701600798821:(num 1701600800398) 2023-12-03 10:56:00,738 DEBUG [RS:0;jenkins-hbase4:44259] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:56:00,738 INFO [RS:0;jenkins-hbase4:44259] regionserver.LeaseManager(133): Closed leases 2023-12-03 10:56:00,739 INFO [RS:0;jenkins-hbase4:44259] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-12-03 10:56:00,739 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-12-03 10:56:00,740 INFO [RS:0;jenkins-hbase4:44259] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44259 2023-12-03 10:56:00,747 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44259,1701600798821 2023-12-03 10:56:00,747 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-12-03 10:56:00,747 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-12-03 10:56:00,747 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44259,1701600798821] 2023-12-03 10:56:00,748 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44259,1701600798821; numProcessing=1 2023-12-03 10:56:00,749 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44259,1701600798821 already deleted, retry=false 2023-12-03 10:56:00,749 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,44259,1701600798821 expired; onlineServers=0 2023-12-03 10:56:00,749 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,46307,1701600797605' ***** 2023-12-03 10:56:00,749 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2023-12-03 10:56:00,749 DEBUG [M:0;jenkins-hbase4:46307] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c69ff7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-12-03 10:56:00,750 INFO [M:0;jenkins-hbase4:46307] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,46307,1701600797605 2023-12-03 10:56:00,750 INFO [M:0;jenkins-hbase4:46307] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,46307,1701600797605; all regions closed. 2023-12-03 10:56:00,750 DEBUG [M:0;jenkins-hbase4:46307] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-03 10:56:00,750 DEBUG [M:0;jenkins-hbase4:46307] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-12-03 10:56:00,750 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-12-03 10:56:00,750 DEBUG [M:0;jenkins-hbase4:46307] cleaner.HFileCleaner(317): Stopping file delete threads 2023-12-03 10:56:00,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701600800038] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701600800038,5,FailOnTimeoutGroup] 2023-12-03 10:56:00,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701600800038] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701600800038,5,FailOnTimeoutGroup] 2023-12-03 10:56:00,750 INFO [M:0;jenkins-hbase4:46307] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-12-03 10:56:00,750 INFO [M:0;jenkins-hbase4:46307] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-12-03 10:56:00,750 INFO [M:0;jenkins-hbase4:46307] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-12-03 10:56:00,751 DEBUG [M:0;jenkins-hbase4:46307] master.HMaster(1512): Stopping service threads 2023-12-03 10:56:00,751 INFO [M:0;jenkins-hbase4:46307] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-12-03 10:56:00,751 ERROR [M:0;jenkins-hbase4:46307] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-12-03 10:56:00,752 INFO [M:0;jenkins-hbase4:46307] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-12-03 10:56:00,752 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-12-03 10:56:00,752 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-12-03 10:56:00,752 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-03 10:56:00,752 DEBUG [M:0;jenkins-hbase4:46307] zookeeper.ZKUtil(399): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-12-03 10:56:00,752 WARN [M:0;jenkins-hbase4:46307] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-12-03 10:56:00,752 INFO [M:0;jenkins-hbase4:46307] assignment.AssignmentManager(315): Stopping assignment manager 2023-12-03 10:56:00,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-12-03 10:56:00,752 INFO [M:0;jenkins-hbase4:46307] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-12-03 10:56:00,753 DEBUG [M:0;jenkins-hbase4:46307] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-12-03 10:56:00,753 INFO [M:0;jenkins-hbase4:46307] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-03 10:56:00,753 DEBUG [M:0;jenkins-hbase4:46307] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-03 10:56:00,753 DEBUG [M:0;jenkins-hbase4:46307] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-12-03 10:56:00,753 DEBUG [M:0;jenkins-hbase4:46307] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-03 10:56:00,753 INFO [M:0;jenkins-hbase4:46307] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=515.58 KB heapSize=601.88 KB 2023-12-03 10:56:00,849 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-12-03 10:56:00,849 INFO [RS:0;jenkins-hbase4:44259] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,44259,1701600798821; zookeeper connection closed. 2023-12-03 10:56:00,849 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): regionserver:44259-0x1004d5f843d0001, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-12-03 10:56:00,849 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c4effbd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c4effbd 2023-12-03 10:56:00,849 INFO [Listener at localhost/33475] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-12-03 10:56:01,160 INFO [M:0;jenkins-hbase4:46307] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=515.58 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d92dd4b3158149a184d79c3daa302327 2023-12-03 10:56:01,163 INFO [M:0;jenkins-hbase4:46307] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d92dd4b3158149a184d79c3daa302327 2023-12-03 10:56:01,164 DEBUG [M:0;jenkins-hbase4:46307] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d92dd4b3158149a184d79c3daa302327 as hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d92dd4b3158149a184d79c3daa302327 2023-12-03 10:56:01,167 INFO [M:0;jenkins-hbase4:46307] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d92dd4b3158149a184d79c3daa302327 2023-12-03 10:56:01,167 INFO [M:0;jenkins-hbase4:46307] regionserver.HStore(1080): Added hdfs://localhost:39337/user/jenkins/test-data/73aefdda-525c-52ab-9d0b-ded90181bfef/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d92dd4b3158149a184d79c3daa302327, entries=123, sequenceid=1011, filesize=33.4 K 2023-12-03 10:56:01,167 INFO [M:0;jenkins-hbase4:46307] regionserver.HRegion(2948): Finished flush of dataSize ~515.58 KB/527950, heapSize ~601.87 KB/616312, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 414ms, sequenceid=1011, compaction requested=false 2023-12-03 10:56:01,168 INFO [M:0;jenkins-hbase4:46307] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-03 10:56:01,168 DEBUG [M:0;jenkins-hbase4:46307] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-12-03 10:56:01,171 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-12-03 10:56:01,171 INFO [M:0;jenkins-hbase4:46307] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-12-03 10:56:01,172 INFO [M:0;jenkins-hbase4:46307] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46307 2023-12-03 10:56:01,174 DEBUG [M:0;jenkins-hbase4:46307] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46307,1701600797605 already deleted, retry=false 2023-12-03 10:56:01,276 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-12-03 10:56:01,276 DEBUG [Listener at localhost/33475-EventThread] zookeeper.ZKWatcher(600): master:46307-0x1004d5f843d0000, quorum=127.0.0.1:62442, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-12-03 10:56:01,276 INFO [M:0;jenkins-hbase4:46307] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,46307,1701600797605; zookeeper connection closed. 2023-12-03 10:56:01,278 WARN [Listener at localhost/33475] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-12-03 10:56:01,281 INFO [Listener at localhost/33475] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-12-03 10:56:01,388 WARN [BP-2009577103-172.31.14.131-1701600794259 heartbeating to localhost/127.0.0.1:39337] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-12-03 10:56:01,388 WARN [BP-2009577103-172.31.14.131-1701600794259 heartbeating to localhost/127.0.0.1:39337] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2009577103-172.31.14.131-1701600794259 (Datanode Uuid 5023ecc4-1dcf-4444-bda1-68c9fa7731a2) service to localhost/127.0.0.1:39337 2023-12-03 10:56:01,390 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/cluster_b90589ee-8101-48f7-b85d-53817d79ec5a/dfs/data/data1/current/BP-2009577103-172.31.14.131-1701600794259] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-12-03 10:56:01,390 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2e8331bb-e829-0c34-b697-c201796e186a/cluster_b90589ee-8101-48f7-b85d-53817d79ec5a/dfs/data/data2/current/BP-2009577103-172.31.14.131-1701600794259] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-12-03 10:56:01,435 INFO [Listener at localhost/33475] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-12-03 10:56:01,571 INFO [Listener at localhost/33475] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-12-03 10:56:01,694 INFO [Listener at localhost/33475] hbase.HBaseTestingUtility(1293): Minicluster is down